Meta AI is pleased to invite university faculty to respond to this call for research proposals for data collection using the Dynabench platform. Launched in 2020, Dynabench is a research platform for dynamic data collection and benchmarking. The Dynabench platform initially comprised four core tasks in natural language processing. It has now reached the level of maturity where we hope it will be useful to the broader research community. Meta aims to open up the platform for anyone interested in human-and-model-in-the-loop data collection to run their own task, and is soliciting proposals for interesting tasks and experiments that Meta can help realize.
Meta AI encourages creative submissions along the theme of “rethinking benchmarking” that leverage the Dynabench platform, with areas of interest that include, but are not limited to, the following:
- New tasks or benchmarks that would benefit from having a dynamic (adversarial) component,
- experiments that examine concrete questions about the human-and-model-in-the-loop paradigm for data collection or evaluation,
- proposals for moving Dynabench beyond natural language processing and/or beyond the English language.
To foster further innovation in this area and deepen our collaborations with academia, Meta AI is pleased to invite university faculty to submit research proposals pertaining to Dynabench. A total of 4 to 8 awards are available, in the range of $15,000 to $55,000 each, including overhead in an amount up to 40% of project costs. Funding will be provided to RFP winners pursuant to a Sponsored Research Agreement (SRA) containing open science terms. Please note that the terms of the SRA will not be subject to negotiation. We strongly encourage researchers from diverse backgrounds and of diverse abilities to apply.