Course positioning
Taught by Dan Yamins, CS 375 (PSYCH 249) is a core course at the intersection of computational neuroscience and AI. It discusses how the internal components of artificial networks correspond to real brain structure, covering feedforward perception, recurrent dynamics, attention/memory/navigation, language Transformers, self-supervision, and deep RL, and teaches how to quantitatively compare models with neural data.
What it covers
- Feedforward perception models: vision, audition, somatosensation
- Recurrent networks: dynamics, motor control
- Attention/memory/navigation: integrated models
- Language and Transformers: modeling language areas
- Self-supervised learning: comparison with brain learning
- Deep RL: decision-making and planning
- Model-neural data comparison: RSA, encoding models, metrics
- Project
Prerequisites
Modern neural network background (one of CS 229/230/231N/234/236/330); no cognitive science/neuroscience background required.
Assessment & workload
Paper discussion plus a project. Check the current syllabus for details.
Who it's for
NeuroAI, computational neuroscience, and AI interpretability; people who want to use AI to understand the brain.
Study advice
Take CS 231N or CS 224N first. Pair with CS 322/EE 292R for a broader view.
Related courses
Official course description
The last ten years has seen a watershed in the development of large-scale neural networks in artificial intelligence. At the same time, computational neuroscientists have discovered a surprisingly robust mapping between the internal components of these networks and real neural structures in the human brain. In this class we will discuss a panoply of examples of such "convergent man-machine evolution", including: feedforward models of sensory systems (vision, audition, somatosensation); recurrent neural networks for dynamics and motor control; integrated models of attention, memory, and navigation; transformer models of language areas; self-supervised models of learning; and deep RL models of decision and planning. We will also delve into the methods and metrics for comparing such models to real-world neural data, and address how unsolved open problems in AI (that you can work on!) will drive forward novel neural models. Some meaningful background in modern neural networks is highly advised (e.g. CS229, CS230, CS231n, CS234, CS236, CS 330), but formal preparation in cognitive science or neuroscience is not needed (we will provide this).