AAAI Publications, 2013 AAAI Spring Symposium Series

Font Size: 
Reliably Evaluating Summaries of Twitter Timelines
Dominic Paul Rout, Kalina Bontcheva, Mark Hepple

Last modified: 2013-03-15

Abstract


The primary view of the Twitter social network service for most users is the timeline, a heterogenous, reverse-chronological list of posts from all connected authors. Previous tweet ranking and summarisation work has heavily relied on retweets as a gold standardfor evaluation. This paper first argues that this is unsatisfactory, since retweets only account for certain kinds of post relevance. The focus of the paper is on designing a user study, through which to create a gold standard for evaluating automatically generated summaries of personal timelines.

Keywords


Thread summarization;Corpus creation

Full Text: PDF