AAAI Publications, Twenty-Ninth AAAI Conference on Artificial Intelligence

Font Size: 
"Is It Rectangular?" Using I Spy as an Interactive, Game-Based Approach to Multimodal Robot Learning
Natalie Paige Parde, Michalis Papakostas, Konstantinos Tsiakas, Rodney D. Nielsen

Last modified: 2015-03-04


Training robots about the objects in their environment requires a multimodal correlation of features extracted from visual and linguistic sources.  This work abstracts the task of collecting multimodal training data for object and feature learning by encapsulating it in an interactive game, I Spy, played between human players and robots.  It introduces the concept of the game, briefly describes its methodology, and finally presents an evaluation of the game's performance and its appeal to human players.


I Spy; 20 Questions; human-robot games; multimodal training data; games with a purpose

Full Text: PDF