UCSD ECE276B: Planning & Learning in Robotics (Spring 2020)
Date | Lecture | Materials | Assignments |
Mar 31 | Introduction, Markov Chains | Grinstead-Snell-Ch11 | |
Apr 02 | Markov Decision Processes | Bertsekas 1.1-1.2 | |
Apr 07 | Dynamic Programming | Bertsekas 1.3-1.4 | HW1, PR1 |
Apr 09 | Deterministic Shortest Path | Bertsekas 2.1-2.3 | HW1 Solutions |
Apr 14 | Configuration Space | LaValle 4.3, 6.2-6.3 | |
Apr 16 | Catch-up | | |
Apr 21 | Search-based Planning | LaValle 2.1-2.3, JPS | |
Apr 23 | Catch-up | | HW2, PR2 |
Apr 28 | Anytime Incremental Search | RTAA*, ARA*, AD*, Journal Paper | HW2 Solutions |
Apr 30 | Sampling-based Planning | LaValle 5.5-5.6 | |
May 05 | Stochastic Shortest Path | Bertsekas 7.1-7.3 | |
May 07 | Bellman Equations I | Sutton-Barto 4.1-4.4 | |
May 12 | Bellman Equations II | Sutton-Barto 4.5-4.8 | HW3, PR3 |
May 14 | Catch-up | | HW3 Solutions |
May 19 | Model-free Prediction | Sutton-Barto 6.1-6.3 | |
May 21 | Model-free Control | Sutton-Barto 6.4-6.7 | |
May 26 | Value Function Approximation | Sutton-Barto Ch.9 | PR4 |
May 28 | Continuous-time Optimal Control | Bertsekas 3.1-3.2 | |
Jun 02 | Pontryagin's Minimum Principle | Bertsekas 3.3-3.4, Liberzon Ch. 2.4 and Ch. 4 | HW4 |
Jun 04 | Linear Quadratic Control | Bertsekas 4.1 |
|
|