Deep RL Course documentation
Additional Readings
Unit 0. Welcome to the course
Unit 1. Introduction to Deep Reinforcement Learning
Bonus Unit 1. Introduction to Deep Reinforcement Learning with Huggy
Live 1. How the course work, Q&A, and playing with Huggy
Unit 2. Introduction to Q-Learning
IntroductionWhat is RL? A short recapThe two types of value-based methodsThe Bellman Equation, simplify our value estimationMonte Carlo vs Temporal Difference LearningMid-way RecapMid-way QuizIntroducing Q-LearningA Q-Learning exampleQ-Learning RecapGlossaryHands-onQ-Learning QuizConclusionAdditional Readings
Unit 3. Deep Q-Learning with Atari Games
Bonus Unit 2. Automatic Hyperparameter Tuning with Optuna
Unit 4. Policy Gradient with PyTorch
Unit 5. Introduction to Unity ML-Agents
Unit 6. Actor Critic methods with Robotics environments
Unit 7. Introduction to Multi-Agents and AI vs AI
Unit 8. Part 1 Proximal Policy Optimization (PPO)
Unit 8. Part 2 Proximal Policy Optimization (PPO) with Doom
Bonus Unit 3. Advanced Topics in Reinforcement Learning
Bonus Unit 5. Imitation Learning with Godot RL Agents
Certification and congratulations
Additional Readings
These are optional readings if you want to go deeper.
Monte Carlo and TD Learning
To dive deeper into Monte Carlo and Temporal Difference Learning:
- Why do temporal difference (TD) methods have lower variance than Monte Carlo methods?
- When are Monte Carlo methods preferred over temporal difference ones?
Q-Learning
- Reinforcement Learning: An Introduction, Richard Sutton and Andrew G. Barto Chapter 5, 6 and 7
- Foundations of Deep RL Series, L2 Deep Q-Learning by Pieter Abbeel