Difference between revisions of "MUC-7 (State of the art)"
Jump to navigation
Jump to search
| Line 37: | Line 37: | ||
Mikheev, A., Grover, C., and Moens, M. (1998). [http://www-nlpir.nist.gov/related_projects/muc/proceedings/muc_7_proceedings/ltg_muc7.pdf Description of the LTG system used for MUC-7]. ''Proceedings of the Seventh Message Understanding Conference (MUC-7)''. Fairfax, Virginia. | Mikheev, A., Grover, C., and Moens, M. (1998). [http://www-nlpir.nist.gov/related_projects/muc/proceedings/muc_7_proceedings/ltg_muc7.pdf Description of the LTG system used for MUC-7]. ''Proceedings of the Seventh Message Understanding Conference (MUC-7)''. Fairfax, Virginia. | ||
| + | |||
| + | == See also == | ||
| + | |||
| + | * [[State of the art]] | ||
Revision as of 11:58, 31 July 2007
- Performance measure: F = 2 * Precision * Recall / (Recall + Precision)
- Precision: percentage of named entities found by the algorithm that are correct
- Recall: percentage of named entities defined in the corpus that were found by the program
- Exact calculation of precision and recall is explained in the MUC scoring software
- Training data: Training section of MUC-7 dataset
- Testing data: Formal section of MUC-7 dataset
Table of results
| System name | Short description | Main publications | Software | Results (F) |
|---|---|---|---|---|
| Human | Human annotator | MUC-7 proceedings | 97.60% | |
| LTG | Best MUC-7 participant | Mikheev, Grover and Moens (1998) | 93.39% |
References
Mikheev, A., Grover, C., and Moens, M. (1998). Description of the LTG system used for MUC-7. Proceedings of the Seventh Message Understanding Conference (MUC-7). Fairfax, Virginia.