Text Mining Support in Semantic Annotation and Indexing of Multimedia Data

Jan Nemrava, David Sadlier, Paul Buitelaar, Thierry Declerck

This short paper is describing a demonstrator that is complementing the paper “Towards Cross-Media Feature Extraction” in these proceedings. The demo is exemplifying the use of textual resources, out of which semantic information can be extracted, for supporting the semantic annotation and indexing of associated video material in the soccer domain. Entities and events extracted from textual data are marked-up with semantic classes derived from an ontology modeling the soccer domain. We show further how extracted Audio-Video features by video analysis can be taken into account for additional annotation of specific soccer event types, and how those different types of annotation can be combined.

Submitted: Sep 13, 2008