December 24, 2024 | BY firojalam
Event Notification Type:
Call for Participation
Abbreviated Title:
CheckThat! Lab
Tuesday, 9 September 2025
Country:
Spain
Contact Email:
City:
Madrid
Contact:
Firoj Alam
Julia Maria Struß
Submission Deadline:
Friday, 25 April 2025
Dear colleague,
We invite you to participate in the 2025 edition of the CheckThat! Lab at CLEF 2025. This year, we feature four tasks — one follow-up and three new — that correspond to important components within and around the full fact-checking pipeline in multiple languages:
- Task 1: Subjectivity in News Articles - Spot text that should be processed with specific strategies, benefiting the fact-checking pipeline. Available in Arabic, English, Bulgarian, German, Italian, and Multilingual.
- Task 2: Claim Normalization - Simplify the primary claim made in the social media post into a concise form. This task is offered in 20 languages: English, Arabic, Bengali, Czech, German, Greek, French, Hindi, Korean, Marathi, Indonesian, Dutch, Punjabi, Polish, Portuguese, Romanian, Spanish, Tamil, Telugu, Thai.
- Task 3: Fact-Checking Numerical Claims - Verify claims with numerical quantities and temporal expressions. Available in Arabic, English, and Spanish.
- Task 4: Scientific Web Discourse Processing (SciWeb) - (a) Classify different forms of science-related online discourse and (b) retrieve the scientific paper that serves as the source for the claim from a given pool of candidate scientific papers. Available in English.
Register and participate: https://clef2025-labs-registration.dei.unipd.it/registrationForm.php
Further information: https://checkthat.gitlab.io/
Datasets: https://gitlab.com/checkthat_lab/clef2025-checkthat-lab
Important Dates
- November 2024: Lab registration opens
- December 2024: Release of the training materials
- 25 April 2025: Lab registration closes
- 30 April 2025: Beginning of the evaluation cycle (test sets release)
- 10 May 2025 (23:59 AOE): End of the evaluation cycle (run submission)
- 30 May 2025: Deadline for the submission of working notes [CEUR-WS]
- 30 May – 27 June 2025: Review process of participant papers
- 9 June 2025: Submission of Condensed Lab Overviews [LNCS]
- 16 June 2025: Notification of Acceptance for Condensed Lab Overviews [LNCS]
- 23 June 2025: Camera Ready Copy of Condensed Lab Overviews [LNCS] due
- 27 June 2025: Notification of Acceptance for Participant Papers [CEUR-WS]
- 7 July 2025: Camera Ready Copy of Participant Papers and Extended Lab Overviews [CEUR-WS] due
- 21-25 July 2025: CEUR-WS Working Notes Preview for Checking by Authors and Lab Organizers
- 9-12 September 2025: CLEF 2025 Conference in Madrid, Spain