UCSD ECE276B: Planning & Learning in Robotics (Spring 2019)Time and Location
Instructors
OverviewThis course covers optimal control and reinforcement learning fundamentals and their application to planning and decision making in robotics. Topics include Markov decision processes (MDP), dynamic programming, search-based and sampling-based planning, value and policy iteration, linear quadratic regulation (LQR), and model-free reinforcement learning. PrerequisitesStudents are expected to have background in Bayesian estimation theory at the level of ECE276A: Sensing & Estimation in Robotics as well as reasonable programming experience. RequirementsThe class assignments consist of a final exam and three projects, each including theoretical problems, programming problems (in Python), and a report. Students are expected to sign up on Piazza and GradeScope:96G4EX. Discussion and important announcements will be made on Piazza. The homework should be turned in and will be graded on GradeScope:96G4EX. GradingGrading will be based on the following rubric.
ReferencesCollaboration and Academic IntegrityPlease note that an important element of academic integrity is fully and correctly attributing any materials taken from the work of others. You are encouraged to work with other students and to discuss the assignments in general terms (e.g., “Do you understand the A* algorithm” or “What is the update equation for Value iteration?”). However, the work you turn in should be your own – you should not split parts of the assignments with other students and you should certainly not copy other students’ code or papers. All projects in this course are individual assignments. More generally, please familiarize yourself with UCSD's Code of Academic Integrity, which applies to this course. Instances of academic dishonesty will be referred to the Office of Student Conduct for adjudication. IDEA Engineering Student CenterPlease consider participating in the programs and events organized by the IDEA Engineering Student Center. The IDEA center, located just to the right of the lobby of Jacobs Hall, is a hub for student engagement, academic enrichment, personal and professional development, leadership, community involvement, and a respectful learning environment for all. The IDEA center's mission is to foster an inclusive and welcoming community, promote academic success, develop engineering leaders, and, most importantly, support your mental health and wellness needs. These opportunities can be found on the IDEA Center Facebook page and the Center web site. |