Learning Continuous Action Models in a Real-Time Strategy Environment

Matthew Molineaux, David W. Aha, Philip Moore

Although several researchers have integrated methods for reinforcement learning (RL) with case-based reasoning (CBR) to model continuous action spaces, existing integrations typically employ discrete approximations of these models. This limits the set of actions that can be modeled, and may lead to non-optimal solutions. We introduce the Continuous Action and State Space Learner (CASSL), an integrated RL/CBR algorithm that uses continuous models directly. Our empirical study shows that CASSL significantly outper-forms two baseline approaches for selecting actions on a task from a real-time strategy gaming environment.

Subjects: 3.1 Case-Based Reasoning; 1.8 Game Playing

Submitted: Feb 25, 2008

This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.