Dear Colleagues,
We are excited to announce that the Leaderboard for SemEval 2025 Task 10: Multilingual Characterization and Extraction of Narratives from Online News is officially open!
Task Overview
The task focuses on analyzing multilingual news articles in two critical domains—Ukraine-Russia War and Climate Change—and is subdivided into three subtasks:
1. Entity Framing
- Goal: Assign fine-grained roles (e.g., protagonist, antagonist, or innocent) to mentions of named entities in a news article.
- Task Type: Multi-label, multi-class text-span classification.
2. Narrative Classification
- Goal: Assign appropriate sub-narrative labels to a news article using a two-level taxonomy of narratives.
- Task Type: Multi-label, multi-class document classification.
3. Narrative Extraction
- Goal: Generate a free-text explanation (up to 80 words) for the dominant narrative in an article, grounded in evidence from the text.
-Task Type: Text-to-text generation.
This task provides an opportunity to push the boundaries of multilingual NLP and tackle challenges related to narrative understanding and extraction.
Important Dates
- Development Set Available: November 11, 2024
- Leaderboard Open: November 11, 2024
- Test Set Release: January, 2025
- Submission Deadline: January, 2025 (keep monitoring the website for precise dates)
How to Participate
1. Visit the official task website: https://propaganda.math.unipd.it/semeval2025task10/
2. Register your team to get access to the data and begin evaluating your models.
3. Submit your predictions to the leaderboard to compare with other participants.
This is a great opportunity to contribute to cutting-edge research in multilingual narrative analysis and to engage with the SemEval community.
We look forward to your participation!
Best regards,
The SemEval 2025 Task 10 Organizers