AAAI Publications, Workshops at the Twenty-Sixth AAAI Conference on Artificial Intelligence

Font Size: 
A Neural-Symbolic Cognitive Agent with a Mind’s Eye
H. L. H. de Penning, R. J. M. den Hollander, H. Bouma, G. J. Burghouts, A. S. d'Avila Garcez

Last modified: 2012-07-15


The DARPA Mind’s Eye program seeks to develop in machines a capability that currently exists only in animals: visual intelligence. This paper describes a Neural-Symbolic Cognitive Agent that integrates neural learning, symbolic knowledge representation and temporal reasoning in a visual intelligent system that can reason about actions of entities observed in video. Results have shown that the system is able to learn and represent the underlying semantics of the actions from observation and use this for several visual intelligent tasks, like recognition, description, anomaly detection and gap-filling.

Full Text: PDF