Course positioning
CS 324 is a foundation-model course launched in 2023, covering the principles, systems, and social impact of models such as GPT-3, CLIP, and Stable Diffusion. It has industry speakers and emphasizes projects over derivations; it suits people who want a fast, broad view of FMs.
What it covers
- FM basics: definitions, history, scaling laws
- Models and algorithms: Transformers, multimodality, diffusion
- Adaptation: prompting, fine-tuning, LoRA, RLHF
- Systems: distributed training, inference, cost
- Ethics and social impact: bias, copyright, misuse, regulation
- Applications: text, images, code, science
- Quarter-long project: study FM capabilities or build an application
Prerequisites
Deep learning background (CS 224N/CS 230/CS 231N level).
Assessment & workload
Mainly a quarter-long final project, possibly with assignments/reading. Check the current syllabus for details.
Who it's for
Product/research/strategy people who want to understand the FM ecosystem; students looking for FM application directions.
Study advice
The content leans 2023; combine it with recent papers. Pick a narrow, deep problem for the project.
Related courses
Official course description
Foundation models (FMs) are transforming the landscape of AI in research and industry. Such models (e.g., GPT-3, CLIP, Stable Diffusion) are trained on large amounts of broad data and are adaptable to a wide range of downstream tasks. In this course, students will learn fundamentals behind the models and algorithms, systems and infrastructure, and ethics and societal impacts of foundation models, with an emphasis on gaining hands-on experience and identifying real-world use-cases for FMs. Students will hear from speakers in industry working on foundation models in the wild. The main class assignment will be a quarter-long final project, involving either researching the capabilities of FMs or building an FM-powered application.