Course positioning
CS 227A (EE 227) is taught by Shuran Song and focuses on how robots understand the environment from raw sensor data and make decisions. It covers sensor hardware, calibration, visual perception, state estimation, and decision-making; assignments build a vision-based robot system step by step.
What it covers
- Sensors: RGB-D, tactile, acoustic, IMU
- Calibration: camera intrinsics/extrinsics, hand-eye calibration
- Visual perception: detection, segmentation, pose estimation
- State estimation: filtering, fusion
- Decision-making: from perception to action
- Simulation practice
- Project/report (4 units require an extra report)
Prerequisites
Python programming; linear algebra; math basics are reviewed in class, but programming demands are high.
Assessment & workload
A series of programming assignments plus an optional final report (4 units). Check the current syllabus for details.
Who it's for
Robot perception, embodied AI, and 3D vision.
Study advice
Take CS 231N or CS 237A first. The assignments are programming-heavy; get comfortable with PyTorch and simulation.
Related courses
Official course description
Robot Perception is the cornerstone of modern robotics, enabling machines to interpret, understand, and respond to an array of sensory information they encounter. In the course, students will study the basic principles of typical sensor hardware on a robotics system (e.g., vision, tactile, and acoustic sensors), the algorithms that process the raw sensory data, and make actionable decisions from that information. Over the course of the semester, students will incrementally build their own vision-based robotics system in simulation via a series of homework coding assignments. Students enrolling 4 units will be required to submit an additional final written report. Prerequisites: This course requires programming experience in python as well as basic knowledge of linear algebra. Most of the required mathematical concepts will be reviewed, but it will be assumed that students have strong programming skills. All the homework requires extensive programming.