Carroll, J., A. Frank, D. Lin, D. Prescher and H. Uszkoreit (eds.) (2002) Proceedings of the Workshop `Beyond PARSEVAL --- Towards improved evaluation measures for parsing systems' at the 3rd International Conference on Language Resources and Evaluation, Las Palmas, Gran Canaria.
Contents:
Beyond PARSEVAL --- Towards improved evaluation measures for parsing
systems (Carroll, Frank, Lin, Prescher and Uszkoreit)
Relational evaluation schemes (Briscoe, Carroll, Graham, and Copestake)
Towards a dependency-oriented evaluation for partial parsing
(Kübler and Telljohann)
LinGO Redwoods --- A rich and dynamic treebank for HPSG (Oepen,
Callahan, Flickinger, Manning and Toutanova)
A test of the leaf-ancestor metric for parse accuracy (Sampson and Babarczy)
Evaluating parser accuracy using edit distance (Roark)
Evaluating syllabification: One category shared by many grammars (Müller)
Towards comparing parsers from different linguistic frameworks:
An information theoretic approach (Musillo and Sima'an)
Evaluation of the Gramotron parser for German (Beil, Prescher,
Schmid, Schulte im Walde)
Evaluating a wide-coverage CCG parser (Clark and Hockenmaier)
A comparison of evaluation metrics for a broad-coverage stochastic parser
(Crouch, Kaplan, King and Riezler)
Download pdf version of complete proceedings.