View source for Sharing data and evaluation (NLG)

<!-- MoinMoin name:  SharingDataAndEvaluation -->
<!-- Comment:         -->
<!-- WikiMedia name: SharingDataAndEvaluation -->
<!-- Page revision:  00000009 -->
<!-- Original date:  Sun Aug 27 22:27:39 2006 (1156717659000000) -->

= INLG'06 Special Session on Sharing Data and Comparative Evaluation =

Sydney, 15 July, 2006.

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/intro-special-session.pdf Introduction to the INLG'06 Special Session on Sharing Data and Comparative Evaluation]
Anja Belz and Robert Dale

== Open Mic contributions (short talks) ==

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-06-horacek.txt Abstract]
Helmut Horacek

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-06-reitter-callaway.pdf Methods, Requirements and Licenses for Shared NLG Resources]
David Reitter and Charles Callaway

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-06-scott-moore.pdf An NLG evaluation competition? Eight reasons to be careful]
Donia Scott and Johanna Moore

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-06-varges.txt Abstract] [http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/varges-shared-tasks.pdf Slides]
Sebastian Varges

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-06-white.txt How NOT to Say It: On the need for human evaluation of what to AVOID in realization ranking]
Michael White

== Papers ==

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-0626.pdf Evaluations of NLG Systems: Common Corpus and Tasks or Common Dimensions and Metrics?]
Cécile Paris, Nathalie Colineau and Ross Wilkinson

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-0627.pdf Building a Semantically Transparent Corpus for the Generation of Referring Expressions.]
Kees van Deemter, Ielka van der Sluis and Albert Gatt

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-0628.pdf Shared-Task Evaluations in HLT: Lessons for NLG]
Anja Belz and Adam Kilgarriff

[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-0629.pdf GENEVAL: A Proposal for Shared-task Evaluation in NLG]
Ehud Reiter and Anja Belz

== Invited Talk ==
[http://homepages.inf.ed.ac.uk/dreitter/siggen/resources/inlg2006specialsession/INLG-0602.pdf Lessons Learned from Large Scale Evaluation of Systems that Produce Text: Nightmares and Pleasant Surprises]
Kathleen R. McKeown


{{SIGGEN Wiki}}