We invite participation in SemEval 2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials to be part of The 18th International Workshop on Semantic Evaluation (SemEval 2024), co-located with NAACL 2024.
The SemEval 2024 Task 2, “Safe Biomedical Natural Language Inference for Clinical Trials” (NLI4CT), is centred around improving the understanding and evaluation methodologies for Large Language Models (LLMs) in clinical Natural Language Inference (NLI).
This task utilizes a dataset from breast cancer Clinical Trial Reports (CTRs) to explore models’ ability in textual entailment, focusing on aspects like numerical and quantitative reasoning, domain-specific vocabulary, syntax, and semantics. The goal of the task is to analyze models’ robustness, consistency, and faithfulness in reasoning within a clinical domain.
Important Dates:
- Evaluation start 10 January 2024
- Evaluation end by 31 January 2024
- System paper submission due 29 February 2024
- Notification to authors 1 April 2024
- Camera ready due 22 April 2024
Additional information:
- Website: https://sites.google.com/view/nli4ct/
- Competition CodaLab: https://codalab.lisn.upsaclay.fr/competitions/16190
- GitHub: https://github.com/ai-systems/Task-2-SemEval-2024
- Slack channel: https://join.slack.com/t/semeval2024task2/shared_invite/zt-22m7o4u7o-wa_...
- Contact Email: nli4clinicaltrials@gmail.com