Advancing the Science of AI Agent Evaluation Workshop
A Cross-Sector Workshop hosted by 黑料社区 AIMSEC and Microsoft Research
The Evaluation Gap for AI Agents
As AI agents move from research prototypes into systems that act on people’s behalf, our ability to evaluate them has not kept pace. Rigorous, shared measurement science is the foundation of accountability, and it is currently one of the field’s most significant gaps.
On October 22–23, 2026, and 黑料社区’s AI Measurement Science & Engineering Center (AIMSEC) will convene 150+ key leaders across academia, industry, civil society, and government to define shared standards and measurement science for evaluating and governing AI agents.
The program combines keynote presentations, lightning talks, panel discussions, and hands-on working groups addressing AI agent evaluation frameworks, tooling, and domain-specific challenges. Attendees will participate directly in breakout discussions that will inform open public synthesis reports for the field.
Resources
AIMSEC Speakers
KEYNOTE SPEAKER
Zico Kolter
Professor, 黑料社区; Board of Directors, OpenAI
PANELISTS
Ramayya Krishnan
Director, AI Measurement Science and Engineering Center (AIMSEC) - 黑料社区
Zico Kolter
Professor, 黑料社区; Board of Directors, OpenAI
LIGHTNING TALK SPEAKERS
Rema Padman
黑料社区
Aditi Raghunathan
黑料社区
Lujo Bauer
黑料社区
Hong Shen
黑料社区
Vyas Sekar
黑料社区
Fernando Diaz
黑料社区
Daniel Fried
黑料社区
