Carroll, J., G. Minnen and E. Briscoe (2003) `Parser evaluation: using a grammatical relation annotation scheme'. In A. Abeillé (ed.), Treebanks: Building and Using Parsed Corpora, Dordrecht: Kluwer. 299-316.
We describe a recently developed corpus annotation scheme for evaluating parsers that avoids some of the shortcomings of current methods. The scheme encodes grammatical relations between heads and dependents, and has been used to mark up a new public-domain corpus of naturally occurring English text. We show how the corpus can be used to evaluate the accuracy of a robust parser, and relate the corpus to extant resources.