Course positioning
CS 348I discusses how deep learning is changing four areas of graphics: rendering, geometry, animation, and imaging. For each problem it presents the classical solution first, then SOTA learned methods, and critically evaluates results and impact — a good fit for graphics + AI.
What it covers
- Differentiable/neural rendering: NeRF, Gaussian Splatting, neural rendering
- Materials and lighting: BRDF estimation, inverse rendering
- Textures and images: texture synthesis, denoising, super-resolution, shading
- Geometry: neural implicits, procedural modeling
- View synthesis: novel-view generation, 3D reconstruction
- Animation: motion synthesis, differentiable physics, RL
- Project
Prerequisites
CS 148; CS 231N recommended.
Assessment & workload
Programming assignments plus a project. Check the current syllabus for details.
Who it's for
Graphics, rendering, 3D generation, and film/game technology.
Study advice
Brush up on graphics fundamentals (ray tracing, BRDF, rendering equation) first. Pair with CS 348N/CS 468.
Related courses
Official course description
This course introduces deep learning methods and AI technologies applied to four main areas of Computer Graphics: rendering, geometry, animation, and imaging. We will study a wide range of problems on content creation for images, shapes, and animations, recently advanced by deep learning techniques. For each problem, we will understand its conventional solutions, study the state-of-the-art learning-based approaches, and critically evaluate their results as well as the impacts to researchers and practitioners in Computer Graphics. The topics include differentiable rendering/neural rendering, BRDF estimation, texture synthesis, denoising, procedural modeling, view synthesis, colorization, style transfer, motion synthesis, differentiable physics simulation, and reinforcement learning. Through programming projects and homework, students who successfully complete this course will be able to use neural rendering algorithms for image manipulation, apply neural procedural modeling for shape and scene synthesis, exploit data-driven methods for simulating physical phenomena, and implement policy learning algorithms for creating character animation. Recommended Prerequisites: CS148, CS231N