Lecture 2 Markov Decision Processes
Lecture 3 Solving Continuous MDPs with Discretization
Lecture 4 MDPs and Function Approximation
Lecture 6 Unconstrained (Convex) Optimization
Lecture 7 Constrained Optimization
Lecture 8 Optimization-based Control: Collocation, Shooting, MPC
Lecture 9 Collocation, Shooting, MPC, Contact-Invariant Optimization
Lecture 10 Motion Planning: PRM, RRT, Trajopt
Lecture 11 Probability Review, Bayes Filters, Gaussians
Lecture 12 Kalman Filters
Lecture 13 Kalman Smoother, MAP, ML, EM
Lecture 14 Particle Filters
Lecture 15 Partially Observable MDPs (POMDPs)
Lecture 17 Imitation Learning
Lecture 18 Reinforcement Learning I: Policy Gradients
Lecture 19 Off-Policy, Model-Free RL: DQN, SoftQ, DDPG, SAC
Lecture 20 Model-Based Reinforcement Learning
Lecture 21 Physics Simulation
Lecture 22 Sim2Real and Domain Randomization
Lecture 23 Guest Lecture: Drones
Lecture 24 Backstories behind how various papers came about
Lecture 25 Autonomous Helicopters (aka my thesis story :)