Latest AI Research in RTS Games

1. Latest AI Research in RTS Games Omar Khaled Enayet – July 2009

2. Index • Why is AI Development Slow in RTS-Games. • AI Areas needing more research. • Adaptation • Planning. • Case-Based Planning. • PDDL. • Learning. • Dynamic Scripting. • Reinforcement Learning. • Hierarchal Reinforcement Learning. • Monte-Carlo Method. • Temporal Difference Learning. • Q-learning. • Evolution Algorithms. • Hybrid CBR-RL. • Opponent Modeling.

3. Introduction • Planning is beginning to appear in commercial games such as DemiGod and Latest Total War Game. • Learning has limited success so far.

4. Case Based Planning • CBR + planning

5. PDDL • See Slides

6. Machine Learning • See Wikipedia

7. Reinforcement Learning • See Tutorial • In 2008 Eric Kok’s thesis : Monte Carlo and Dynamic Scripting

8. Monte-Carlo Method

9. Temporal Difference Learning

10. Q-Learning

11. Hybrid CBR-RL