Stanford AI Course Map 中文 GitHub ↗
← Back to the course map
Stanford · 2026—27 CS 229S ML Systems & Hardware ★★★★☆

Core course · ML Systems & Hardware

Systems for Machine Learning

中文:机器学习系统

ML systems: efficiency across the data, training, and inference stack, with hardware-software co-design.

Draft translation: official facts are checked; wording may change after native review.

Not offered in the 2026–27 ExploreCourses listing; no stable course-site link found.

3 units Not scheduled in 2026–27 Letter or Credit/No Credit ★★★★☆
MLSysSystemsDistributedPerformance

Course positioning

CS 229S looks at machine learning from a systems perspective: models are bigger, data is larger, hardware is more heterogeneous — where is the performance bottleneck? It covers data pipelines, distributed training, GPUs/accelerators, networking, inference serving, and compilation, for people who want to work on MLSys/infrastructure.

What it covers

  1. Data pipelines: collection, cleaning, storage, throughput
  2. Distributed training: data, model, and pipeline parallelism
  3. Accelerators: GPUs/TPUs, memory hierarchy, interconnects
  4. Communication and networking: all-reduce, RDMA, topology
  5. Inference serving: batching, scheduling, KV cache, latency
  6. Compilation and kernels: XLA, TVM, Triton
  7. Cases and project: performance analysis of real systems

Prerequisites

CS 224N or CS 229; systems/architecture background helps.

Assessment & workload

Assignments plus a project, focused on systems implementation and performance analysis. Check the current syllabus for details.

Who it's for

People who want to work on MLSys, inference infrastructure, or training platforms; systems people moving into ML.

Study advice

Pair with CS 149 (parallel computing) and CS 217 (accelerators). Understand the roofline model and communication costs first.

Related courses

Official course description

Deep learning and neural networks are being increasingly adopted across industries. They are now used to serve billions of users across applications such as search, knowledge discovery, and productivity assistants. As models become more capable and intelligent, this trend of large-scale adoption will continue to grow rapidly. Due to the widespread application, there is an increasing need to achieve high performance for both training and serving deep-learning models. However, performance is hindered by a multitude of infrastructure and lifecycle hurdles - the increasing complexity of the models, massive sizes of training and inference data, heterogeneity of the available accelerators and multi-node platforms, and diverse network properties. The slow adaptation of systems to new algorithms creates a bottleneck for the rapid evolution of deep-learning models and their applications. This course will cover systems approaches for improving the efficiency of machine learning pipelines - comprising data preparation, model training, and model deployment & inference -at each level of the systems stack spanning software and hardware. Pre-req: CS224N or CS229.