LATEST AI RESEARCH IN RTS GAMES

Omar Khaled Enayet – July 2009

Index

Why is AI Development Slow in RTS-Games. AI Areas needing more research. Adaptation

Planning. Case-Based Planning. PDDL.

Learning. Dynamic Scripting. Reinforcement Learning.

Hierarchal Reinforcement Learning. Monte-Carlo Method. Temporal Difference Learning. Q-learning. Evolution Algorithms.

Hybrid CBR-RL. Opponent Modeling.

Introduction

Planning is beginning to appear in commercial games such as DemiGod and Latest Total War Game.

Learning has limited success so far.

Case Based Planning

CBR + planning

PDDL

See Slides

Machine Learning

See Wikipedia

Reinforcement Learning

See Tutorial In 2008 Eric Kok’s thesis : Monte Carlo

and Dynamic Scripting

Monte-Carlo Method

Temporal Difference Learning

Q-Learning

Hybrid CBR-RL