课程定位
基准、心理测量与效度理论,系统评估 AI 能力。 本页保留官方档案与入口,具体内容与考核以当季官网为准。
主要内容
本页为延伸课程速览,主要内容见下方官方描述。
先修
见官方描述(延伸课程暂未单独整理先修)。
考核与工作量
以当季官网为准(延伸课程暂未单独整理考核)。
适合谁
对「AI 测量科学」方向感兴趣的人。
学习建议
先读官方描述和课程官网,再判断是否适合自己。
相关课程
官方课程描述(英文原文)
Artificial Intelligence (AI) measurement science provides frameworks and methodologies for evaluating, benchmarking, and understanding AI systems. As AI systems become increasingly powerful and deploy into high-stakes domains, the need for rigorous measurement approaches has grown in importance. Current measurement approaches are often ad hoc, lacking theoretical grounding, and failing to connect to real-world use cases. This has led to a measurement crisis characterized by benchmark saturation, inconsistent evaluation methodologies, and difficulty in making valid claims about AI capabilities. This course will cover the foundations of AI measurement science from first principles and outline connections to the growing literature on the topic. This includes: validity theory as applied to AI evaluation, focusing on content, criterion, construct, external, and consequential validity; psychometric models for AI measurement, including item response theory and latent variable models; scaling laws and intervention effects, predicting the impacts of data, computing, and architecture choices; synthetic data generation for evaluation and its implications; governance and policy considerations around AI measurement. This is a graduate-level course. By the end of the course, students should be able to understand, implement, and critique state-of-the-art AI measurement approaches and be ready to conduct research on these topics.