Call for participation: TREC Health Misinformation Track 2021
https://trec-health-misinfo.github.io
AIMS AND SCOPE
--------------------------
Misinformation represents a key problem when using search engines to guide any decision-making task: Are users able to discern authoritative from unreliable information and correct from incorrect information? This problem is further exacerbated when the search occurs within uncontrolled data collections, such as the web, where information can be unreliable, misleading, highly technical, and can lead to unfounded escalations. Information from search-engine results can significantly influence decisions, and research shows that increasing the amount of incorrect information about a topic presented in a Search Engine Result Page (SERP) can impel users to make incorrect decisions.
In this context, the TREC 2021 Misinformation track fosters research on retrieval methods that promote reliable and correct information over misinformation. The track offers the following task:
* Ad-hoc Retrieval Task: The goal is to design a ranking model that promotes credible and correct information over incorrect information;
GUIDELINES
--------------------------
* Corpus: noclean version of the C4 dataset (https://huggingface.co/datasets/allenai/c4);
* Topics: about consumer health search (people seeking health advice online);
* Runs: runs may be either automatic or manual with the standard TREC run format.
Detailed guidelines on: https://trec-health-misinfo.github.io
IMPORTANT DATES
--------------------------
* Runs due from participants: September 2, 2021
* Evaluation results returned: End of September 2021
* Notebook paper due: October 2021
* TREC 2021 Conference: November 17-19, 2020
* Final paper due: February 2021
ORGANIZERS
--------------------------
* Charles Clarke, University of Waterloo
* Maria Maistro, University of Copenhagen
* Mark Smucker, University of Waterloo
CONTACT
--------------------------
For more information or to ask questions, join the google group: https://groups.google.com/forum/#!forum/trec-health-misinformation-track