Difference between revisions of "Question Answering (State of the art)"
Jump to navigation
Jump to search
(Created page with "== Answer Sentence Selection == The task of answer sentence selection is designed for the open-domain question answering setting. Given a question and a set of candidate sent...") |
|||
| Line 46: | Line 46: | ||
== References == | == References == | ||
* Wang, Mengqiu and Smith, Noah A. and Mitamura, Teruko. [http://www.aclweb.org/anthology/D/D07/D07-1003 What is the Jeopardy Model? A Quasi-Synchronous Grammar for QA]. In EMNLP-CoNLL 2007. | * Wang, Mengqiu and Smith, Noah A. and Mitamura, Teruko. [http://www.aclweb.org/anthology/D/D07/D07-1003 What is the Jeopardy Model? A Quasi-Synchronous Grammar for QA]. In EMNLP-CoNLL 2007. | ||
| − | + | * Heilman, Michael and Smith, Noah A. [http://www.aclweb.org/anthology/N10-1145 Tree Edit Models for Recognizing Textual Entailments, Paraphrases, and Answers to Questions]. In NAACL-HLT 2010. | |
| − | + | * E. Shnarch. Probabilistic Models for Lexical Inference. Ph.D. thesis, Bar Ilan University. 2013. | |
| + | * Yao, Xuchen and Van Durme, Benjamin and Callison-Burch, Chris and Clark, Peter. [http://www.aclweb.org/anthology/N13-1106 Answer Extraction as Sequence Tagging with Tree Edit Distance]. In NAACL-HLT 2013. | ||
| + | * Yih, Wen-tau and Chang, Ming-Wei and Meek, Christopher and Pastusiak, Andrzej. [http://research.microsoft.com/pubs/192357/QA-SentSel-Updated-PostACL.pdf Question Answering Using Enhanced Lexical Semantic Models]. In ACL 2013. | ||
| + | * Severyn, Aliaksei and Moschitti, Alessandro. [http://www.aclweb.org/anthology/D13-1044 Automatic Feature Engineering for Answer Selection and Extraction]. In EMNLP 2013. | ||
[[Category:State of the art]] | [[Category:State of the art]] | ||
Revision as of 15:09, 21 January 2014
Answer Sentence Selection
The task of answer sentence selection is designed for the open-domain question answering setting. Given a question and a set of candidate sentences, the task is to choose the correct sentence that contains the exact answer and can sufficiently support the answer choice.
| Algorithm | Reference | MAP | MRR |
|---|---|---|---|
| Wang (2007) | Wang et al. (2007) | 0.603 | 0.685 |
| H&S (2010) | Heilman and Smith (2010) | 0.609 | 0.692 |
| W&M (2010) | Wang and Manning (2010) | 0.595 | 0.695 |
| Yao (2013) | Yao et al. (2013) | 0.631 | 0.748 |
| Shnarch (2013) - Backward | Shnarch (2013) | 0.686 | 0.754 |
| Yih (2013) - LCLR | Yih et al. (2013) | 0.709 | 0.770 |
References
- Wang, Mengqiu and Smith, Noah A. and Mitamura, Teruko. What is the Jeopardy Model? A Quasi-Synchronous Grammar for QA. In EMNLP-CoNLL 2007.
- Heilman, Michael and Smith, Noah A. Tree Edit Models for Recognizing Textual Entailments, Paraphrases, and Answers to Questions. In NAACL-HLT 2010.
- E. Shnarch. Probabilistic Models for Lexical Inference. Ph.D. thesis, Bar Ilan University. 2013.
- Yao, Xuchen and Van Durme, Benjamin and Callison-Burch, Chris and Clark, Peter. Answer Extraction as Sequence Tagging with Tree Edit Distance. In NAACL-HLT 2013.
- Yih, Wen-tau and Chang, Ming-Wei and Meek, Christopher and Pastusiak, Andrzej. Question Answering Using Enhanced Lexical Semantic Models. In ACL 2013.
- Severyn, Aliaksei and Moschitti, Alessandro. Automatic Feature Engineering for Answer Selection and Extraction. In EMNLP 2013.