UCSD ECE276B: Planning & Learning in Robotics (Winter 2018)

Date	Lecture	Materials	Assignments
Jan 09	Introduction
Jan 11	Markov Chains	Grinstead-Snell-Ch11
Jan 16	Markov Decision Processes	Bertsekas 1.1-1.2	HW1
Jan 18	Dynamic Programming	Bertsekas 1.3-1.4
Jan 23	Deterministic Shortest Path	Bertsekas 2.1-2.3
Jan 25	Catch-up
Jan 30	Configuration Space	LaValle 4.3, 6.2-6.3	HW2
Feb 01	Search-based Planning	LaValle 2.1-2.3, JPS
Feb 06	Anytime Incremental Search	RTAA, ARA, AD*, Journal Paper
Feb 08	Catch-up
Feb 13	Sampling-based Planning	LaValle 5.5-5.6
Feb 15	Stochastic Shortest Path	Bertsekas 7.1-7.3
Feb 20	Bellman Equations I	Sutton-Barto 4.1-4.4	HW3
Feb 22	Bellman Equations II	Sutton-Barto 4.5-4.8
Feb 27	Continuous-time Optimal Control	Bertsekas 3.1-3.2
Mar 01	Pontryagin's Minimum Principle	Bertsekas 3.3-3.4, Liberzon Ch. 2.4 and Ch. 4
Mar 06	Catch-up
Mar 08	Linear Quadratic Control	Bertsekas 4.1	HW4
Mar 13	Model-free Prediction	Sutton-Barto 6.1-6.3
Mar 15	Model-free Control	Sutton-Barto 6.4-6.7