Toshihiro Matsui and Hideki Asoh, Electrotechnical Laboratory; John Fry, Stanford University; Youichi Motomura, Futoshi Asano, Takio Kurita, Isao Hara, and Nobuyuki Otsu, Electrotechnical Laboratory
Our Jijo-2 mobile robot, whose purpose is to provide office services, such as answering queries about people’s location, route guidance, and delivery tasks, is expected to conduct natural spoken conversation with the office dwellers. This paper describes dialogue technologies implemented on our Jijo-2 office robot, i.e. noise-free voice acquisition system by a microphone array, inference of under-specified referents and zero pronouns using the attentional states, and context-sensitive construction of semantic frames from fragmented utterances. The behavior of the dialogue system integrated with the sound source detection, navigation, and face recognition vision is demonstrated in real dialogue examples in a real office.