Reinforcement
13 concepts, 13 reviewed and merged.
Control
Foundations
- Bellman EquationThe value of where you are is the reward you get now plus the value of where you end up.verified
- Credit AssignmentSomething good happened.verified
- Markov Decision ProcessAn agent in a state picks an action, the world moves it to a new state and pays it a reward, and the loop repeats.verified
- Value FunctionHow good is it to be here? A value function answers that with one number per state — the total reward you expect to…verified
Methods
- Actor-CriticTwo learners working together: an actor that chooses what to do and a critic that judges how good the situation is.verified
- Advantage EstimationWas this action better than what I would normally have done here? That is the advantage — the value of an action…verified
- Policy GradientRather than learning what each state is worth and acting greedily, adjust the behaviour itself: make the actions that…verified
- Q-LearningLearn a number for every state-action pair saying how good that action is there, and always update as though you will…verified
- Reward ShapingAdd extra rewards along the way so the agent gets feedback before the end.verified
- Self-PlayA system improves by playing against itself.verified
- Temporal Difference LearningWait until the end of the game to learn what your moves were worth and you learn slowly and rarely.verified