Difference between revisions of "2016Q1 Reports: TACL Journal"

From Admin Wiki
Jump to navigation Jump to search
m
Line 41: Line 41:
 
[[File:TACL_All_first_decisions.Feb2016.png]]
 
[[File:TACL_All_first_decisions.Feb2016.png]]
  
One sees a pattern of more submissions (cyan line) toward the end of calendar yearw, which probably corresponds to conference submission deadlines occurring in the spring. Spikes in number of submissions generally correlate with a subsequent spike in average time to first decision. The winter breaks and vacations seem to lengthen decision times, understandably. Overall, the number of submissions is going up, and (thus?) time to first decision has been increasing a bit since  early 2014.  
+
Of the 497 papers that received a first decision over this time period, 10% received an (a), 22% a (b), 32% a (c), and 35%  (d). )f the 52 receiving an (a) on the first go-round, the vast majority were resubmissions of a paper that had been previously rejected with encouragement to resubmit.  
 
 
  
 
Misc. notes:
 
Misc. notes:
 
* Submissions for which some technical problem required resubmission are not double-counted.  There have been some 40 papers over the past year where the submission violated formatting rules (often A4 was mistakenly submitted instead of letter).  This takes up more manual  processing and emailing time than seems right,.
 
* Submissions for which some technical problem required resubmission are not double-counted.  There have been some 40 papers over the past year where the submission violated formatting rules (often A4 was mistakenly submitted instead of letter).  This takes up more manual  processing and emailing time than seems right,.
 
* Days to first decision is approximated in several ways, such as that the date of submission is rounded to the nearest submission daedline.
 
* Days to first decision is approximated in several ways, such as that the date of submission is rounded to the nearest submission daedline.

Revision as of 04:38, 21 February 2016

Personnel

  • Mark Johnson and Kristina Toutanova have joined Lillian Lee as co-editors-in-chief!
  • Sincere gratitude to our retiring action editor Janyce Wiebe. We are very glad to have the new action editors Phil Blunsom (University of Oxford and Google DeepMind), Chris Quirk (Microsoft Research), Hinrich Schütze (University of Munich), Holger Schwenk (Facebook AI Research), Scott Wen-tau Yih (Microsoft Research), and Luke Zettlemoyer (University of Washington) join, and to have Bo Pang (Google Research) come back as a TACL action editor after a pause.
  • We have expanded the roster of reviewers thanks mainly to Cindy's great efforts.

Policy updates

  • We have a precedent for consequences in case of multiple submission to a conference and TACL, but have not formulated a general policy.
  • Mark Johnson is developing a publication ethics statement. This is an important step in the process of getting the journal indexed by several major bodies.


Biggest pending issues

  • System Hosting.
We are considering move to a different machine hosted somewhere else to improve the reliability of the system.
Professional short-term help by a developer would be very useful if available.


  • Conference interface.
To integrate the handling of TACL papers into the START-based workflow of the conferences, EMNLP 2015 and NAACL 2016 did or will create a special track in START. TACL provides the conference with author contact info, and the authors upload their papers and metadata into the START track. We understand from EMNLP 2015 that this worked well.
Checking for double submissions to TACL and conferences or undeclared re-submission of conference rejected papers: The TACL co-editors and conference PC chairs exchange information on submissions to be able to do this check. We have caught multiple cases of violations of the multiple submission policy.



Selected minor procedure/system updates:

  • We have updated the style files for submissions and now require the use of these files.
  • We have updated the reviewer information in the system to improve search for suitable reviewers (thanks to Cindy).


Some statistics

There are currently 22 papers that have not yet received any decision, 7 of which are from the January 2016 round, and thus 15 of which are from the current, Feb 2016 round.

Here is a plot of the history of the number of submissions and the days to first decision for papers that have received a first decision, where the time period is for the lifetime of TACL on the OJS server (we don't have the records for the early days when TACL was hosted at START).

TACL All first decisions.Feb2016.png

Of the 497 papers that received a first decision over this time period, 10% received an (a), 22% a (b), 32% a (c), and 35% (d). )f the 52 receiving an (a) on the first go-round, the vast majority were resubmissions of a paper that had been previously rejected with encouragement to resubmit.

Misc. notes:

  • Submissions for which some technical problem required resubmission are not double-counted. There have been some 40 papers over the past year where the submission violated formatting rules (often A4 was mistakenly submitted instead of letter). This takes up more manual processing and emailing time than seems right,.
  • Days to first decision is approximated in several ways, such as that the date of submission is rounded to the nearest submission daedline.