J. Gurney, E. Kipple, and T. Gregory
The spoken language navigation task requires a user to navigate through a virtual landscape (displayed on a monitor) using only natural language, that is, without the use of a mouse or keyboard. This "hands-free/eyes-free" human/computer interaction has been sought after by users who must work in moving vehicles and otherwise disruptive, busy, and distracting conditions. An additional reason for exploring this kind of task is to study how users might employ the significant expressive power of human language. The key issues we address are: (1) the representation of linguistic meaning, (2) the representation of a non-linguistic perceived scene as the current state of the virtual world, and (3) the communication between the two in order to accomplish the navigation task.