课程定位
CS 286 由 Serena Yeung 讲授,深入讨论视觉基础模型在生物医学中的应用。课程覆盖表征学习、扩散/生成模型、vision-language 模型,以及模型大小、计算、训练/推理设置和数据等真实落地问题。
主要内容
- 视觉 FM:CLIP、DINO、SAM 等
- 表征学习:自监督、对比学习
- 生成模型:扩散、图像翻译
- Vision-language:报告生成、VQA
- 计算与数据:模型规模、训练/推理、数据偏差
- 医疗应用:病理、放射、手术
- 论文分析与项目
先修
CS 231N 或 BIODS 220 级深度学习/视觉基础。
考核与工作量
论文分析 + 课堂讨论 + final project。具体以当季官网为准。
适合谁
医疗影像、CV 研究、AI4Science 方向的研究生。
学习建议
先修 CS 231N。课程偏研究,选一个窄的临床问题做深。
相关课程
官方课程描述(英文原文)
This course in artificial intelligence will provide a deep dive into advanced computer vision techniques for reasoning about visual data, and their real-world use in biomedicine. We will cover current cutting-edge models including different families of vision foundation models from representation learners to diffusion and generative models, and both vision-only and vision-language models. We will also cover considerations for real-world use, including model size and computation, training and inference settings, and training data, focusing on applications in biomedicine. Students will be actively engaged in studying and analyzing recent advancements through written analyses, class discussions, and a final project. This course is considered an advanced course and students should be comfortable with deep learning and computer vision at the level of CS231N or BIODS220.