Improving Dialogue Annotation Reliability

Teresa Sikorski

Data collection and annotation represent the most significant portion of the effort involved in building statistical models of dialogue. We must be able to annotate reliably if there is any hope of building predictive statistical models. This paper describes the annotation process being used to tag the TRAINS-93 corpus with dialogue acts, and measures we have taken to improve inter-annotator reliability.


This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.