课程定位
对齐研究的阅读、复现与项目实践。 本页保留官方档案与入口,具体内容与考核以当季官网为准。
主要内容
本页为延伸课程速览,主要内容见下方官方描述。
先修
见官方描述(延伸课程暂未单独整理先修)。
考核与工作量
以当季官网为准(延伸课程暂未单独整理考核)。
适合谁
对「AI 对齐研究」方向感兴趣的人。
学习建议
先读官方描述和课程官网,再判断是否适合自己。
相关课程
官方课程描述(英文原文)
In this course we will explore the current state of research in the field of AI alignment, which seeks to bring increasingly intelligent AI systems in line with human values and interests. As the energy in the AI alignment landscape has been increasingly focused on political considerations, we seek to create a space to discuss which direction we should be pointing in, now that we have a better idea of what AI scaling will look like in the near future. This is a philosophical task, and we will invite several speakers that are philosophical in persuasion, but we also find that several of the most relevant philosophical questions cannot be asked without a strong technical familiarity with the specifics of language models and reinforcement learning. The format will consist of weekly lectures in which speakers present their relationships to the alignment problem and their current research approaches. Before each speaker, we will have some corresponding assigned readings and we will assign some form of active engagement with the material: we will accept a blog post in response to the ideas in the readings, but we will encourage jupyter notebooks that engage with the technical material directly. Therefore this course requires research experience, preferably using mathematical and programming tools (e.g. Python, PyTorch, calculus), and is a graduate level course, open to advanced undergraduates.