2010Q3 Reports: ACL Anthology
[ Link to 2008 Q3 report ] [ Link to 2009 Q3 report ]
ACL ANTHOLOGY Report June 2010, Min-Yen Kan
(please see the items for discussion at the end of the report)
In Progress.
The ACL Anthology is a digital archive of research papers in computational linguistics, sponsored by the CL community, and freely available to all. Conference proceedings are published in the anthology around the same time as the conference (subject to general/program chairs' discretion). CL articles are published within a few days of publication on the MIT Press website (now that CL is open access).
The anthology now contains over 17,100 papers (added over 1000 articles from twelve months ago). Most of the papers are also indexed by Citeseer and Google Scholar, helping the citation counts of ACL authors. The ACM Digital Library is creating rich metadata and doing full citation linking for all Anthology materials.
CHANGES OVER LAST 12 MONTHS: As promised, we have finished the ingestion of IJCNLP 2005 and 2008 and have incorporated the listing of LREC 2008 papers. We have also worked with ACL conference organizers to list the conference and associated workshop papers on the dates of the conference. Similarly, CL journal issues are usually listed and anthologized within 48 hours of release from the MIT Press website.
We have also been very busy making sure the coverage of DBLP and ACM Portal cover the Anthology materials more authoritatively. We have sent updates to both providers, in their required ingestion format, listing 100+ events that need to be updated. This corresponds to over several thousand papers that were not listed by one or both databases. This should help your citation counts and coverages. However, we cannot guarantee whether or when these updates will take effect -- this is conditional on the corresponding target database's policy and schedule.
MAILING LIST: The Anthology mailing list's (http://groups.google.com/group/acl-anthology) membership pool has grown, now consisting of 176 members (up from 94 from last report). This is an announcement-only list, where we notify members of newly listed released materials online.
FUTURE MATERIALS: We are looking to further incorporate additional materials from other CL related conferences. ROCling's set of conference materials has been uploaded for our processing, and will be incorporated, pending edits to provide English translations of both author names and titles. We are in the planning stage for incorporating past LRECs when they are made available and the upcoming RANLP 2009 conference.
ONGOING WORK: While we incorporate more materials for CL, we are working with START (courtesy connections from Steven Bird) to directly support the ACL Anthology XML format to make future events using the aclpub package easier to incorporate directly into the Anthology.
Another large tract of our current work is on providing a uniform level of service and metadata for past work. There are a number of issues that are being tackled:
- Correct XML representation of each article: names of authors (with diacritics for European names), first, "von" and last name portions
- BibTeX representations for all articles
- One PDF file per article. This is especially problematic for the J79 series, which largely represents one issue per PDF file.
- Text for all PDF files. Some articles (e.g., EACL 2003) only exist in image form in the Anthology, rendering indexing (and hence subsequent citation) of these articles problematic.
- PDF metadata fixing for all articles. Crucially, Google Scholar uses this information but it is not always correctly generated.
With these issues fixed, we can proceed to wikify the Anthology, to allow more flexibility in adding, correcting metadata that members or outsiders can directly suggest. Currently, Ali Hakim is working on some initial test phases to do this.
RELATED WORK: Min is also working on creating an LDC release of the ACL Anthology Reference Corpus, which is a separate project, sanctioned earlier by the ACL. This project will incorporate OCR dumped text for all pages in the reference corpus (a subset of all articles up to 2006) and PNG images for each page in the corpus. This work should be ready by the end of the year.
FOR DISCUSSION:
- The mission of the Anthology is eternally up for debate. I have tried to lean less heavy on editorializing, and rather concentrate on providing more content -- whatever its quality -- to the ACL Anthology audience, as long as it is related to CL/NLP and cleared to list by the appropriate authorities. A problem arises when we need to decide whether to ingest new materials (for example, literature not in English, or only peripherally related to CL/NLP). Currently, we implement a permissive policy on this aspect.
- One aspect where this comes up is in listing venues on the front page. While the vast majority of users may never use the front page (but get to the Anthology's details from search engines), currently we list ACL events at the top and other venues in a separate space. While fair and consistent, this marginalizes ACL events that are mainly sponsored by SIGs (notably EMNLP, SemEval, CoNLL) as they are relegated to the pages for SIGs. Would we want to change this policy and if so, what policy should be implemented?