Planning

8 concepts, 8 reviewed and merged.

Control

Model Predictive ControlPlan a sequence of actions over a short horizon, execute only the first one, then throw the rest away and plan again.verified

Foundations

World ModelLearn to predict what the environment does next, then practise inside that prediction instead of in the world.verified

Methods

Hierarchical RLDeciding every muscle twitch and deciding where to go are different problems at different timescales.verified
Imitation LearningRather than specify a reward, show the behaviour you want and have the model copy it.verified
Model-Based RLModel-free methods learn what to do; model-based methods learn how the world works and then work out what to do.verified

Regimes

Search

Monte Carlo Tree SearchSearch a game tree without expanding all of it.verified