Course positioning
MS&E 319 studies the algorithmic problems of generative models under compute constraints. It discusses how objectives, architectures, data pipelines, inference, and serving systems are shaped by compute/latency/memory/data, using LLMs as the main case; students give one presentation and complete a survey or research project.
What it covers
- Compute constraints: inference depth, compute, latency, memory, data
- Objectives and architectures: scaling, sparsity, mixture of experts
- Data pipelines: quality, mixing, synthetic data
- Inference: sampling, speculative decoding, test-time compute
- Serving: batching, caching, scheduling
- Algorithmic problems: new problems under constraints
- Presentation + survey/project
Prerequisites
ML/LLM basics; algorithmic and systems awareness.
Assessment & workload
One presentation plus a survey or research project. Check the current syllabus for details.
Who it's for
People who want to work on inference efficiency, generative-model algorithms, or ML systems; graduate students.
Study advice
Pair with CS 349E for engineering implementation and CS 336 for model training.
Related courses
Official course description
As generative models become central to computing, their progress increasingly depends on algorithms that trade reasoning depth, computational cost, latency, memory, and data. This course studies those tradeoffs with a primary focus on modern language models. We examine how objectives, architectures, data pipelines, inference procedures, and serving systems are shaped by computational constraints, and how these constraints open new algorithmic questions. Students give one presentation and complete either a survey or a research project. May be repeated for credit.