We are finally launching the 2024 GEM multilingual shared task! It comprises 2 main tasks, Data-to-text generation and Summarization, each of which has 3 subtasks. You can submit automatically generated outputs for one or more subtask(s), in Arabic, Chinese, English, German, Hindi, Korean, Russian, Spanish, and/or Swahili. The deadline for pre-registering your system submissions is March 8th 23.59 AoE (see link below). Note that it will be possible for participants to pre-register after March 8th, but that doing so does not guarantee a participation in the human evaluation.
We are delighted to announce that the GEM shared task is endorsed by SIGGEN, and will be part of the Generation Challenges (GenChal) at INLG’24. Participants will have the possibility to (i) publish a system description in the GenChal proceedings (available on the ACL anthology), and (ii) present their results during the GenChal session at the INLG conference in Tokyo in September 2024. See links below.
Important dates
March 8: Deadline for pre-registering systems (pre-registration will remain open until the submission date; late pre-registrations do not guarantee participation to the human evaluation).
April 5: Deadline for output submission (all subtasks).
April 6: Human evaluation starts.
TBD: System descriptions due.
Late September: GenChal@INLG’24
GEM-ST website: https://gem-benchmark.com/shared_task.
SIGGEN page: https://siggen-acl.github.io/index.html.
GenChal’23 Proceedings: https://aclanthology.org/volumes/2023.inlg-genchal/.
Pre-registration: https://nyustern.az1.qualtrics.com/jfe/form/SV_8qRqfdN3qBy3Bqe.