AAAI Publications, Twenty-Seventh AAAI Conference on Artificial Intelligence

Font Size: 
Understanding Descriptions of Visual Scenes Using Graph Grammars
Daniel Bauer

Last modified: 2013-06-29


Automatic generation of 3D scenes from descriptions has applications in communication, education, and entertainment, but requires deep understanding of the input text. I propose thesis work on language understanding using graph-based meaning representations that can be decomposed into primitive spatial relations. The techniques used for analyzing text and transforming it into a scene representation are based on context-free graph grammars. The thesis develops methods for semantic parsing with graphs, acquisition of graph grammars, and satisfaction of spatial and world-knowledge constraints during parsing.


Language Understanding; Deep Semantic Parsing; Visual Scenes; Graph Grammars; Text-to-Scene Generation

Full Text: PDF