Evaluating Architectures for Intelligence
Papers from the 2007 AAAI Workshop
Gal A. Kaminka and Catherina R. Burghart, Program Cochairs
Technical Report WS-07-04 published by The AAAI Press, Menlo Park, California
This technical report is also available in book and CD format.
Contents
Organizing Committee / iii
Gal A. Kaminka and Catherina R. Burghart
Preface / vii
Gal A. Kaminka and Catherina R. Burghart
Formal Evaluation of Agent Architectures / 1
N. Alechina and B. S. Logan
Developmental Cost for Models of Intelligence / 5
Jacob Beal
Cognition-Oriented Building Blocks of Future Benchmark Scenarios for Humanoid Home Robots / 9
Catherina R. Burghart, Ralf Mikut, and Hartwig Holzapfel
Cognitive Architecture as Revolutionary Science / 16
Nicholas L. Cassimatis and Paul Bello
A Testbed for Evaluation of Architectures for Physical Agents / 19
Dongkyu Choi, Michael Morgan, Chunki Park, and Pat Langley
Intelligently Engineering Artificial Intelligence Engineering: The Cognitive Architectures Competition / 23
Dan Diaper, Christian Huyck, Bala Amavasai, Xiaochun Cheng, and Mourad Oussalah
Evaluating Cognitive Models and Architectures / 27
Marc Halbrügge
Towards an Empirical Exploration of Design Space / 31
Nick Hawes, Aaron Sloman, and Jeremy Wyatt
Developing and Evaluating Cognitive Architectures with Behavioural Tests / 36
Peter C. R. Lane and Fernand Gobet
Evaluating Agent Architectures Using Simulation / 40
B. S. Logan
Evaluating Cognitive Architectures for Intelligent and Autonomous Unmanned Vehicles / 44
Lyle N. Long and Scott D. Hanford
Architectural Factors for Intelligence in Autonomous Systems / 48
Ignacio López, Ricardo Sanz, and Carlos Hernández
A Gauntlet for Evaluating Cognitive Architectures / 53
Marc Pickett I, Don Miner, and Tim Oates
Evaluation of Cognitive Architectures: A Software Evaluation Perspective / 58
Bilge Say
Metrics for Cognitive Architecture Evaluation / 60
Robert Wray and Christian Lebiere