|Talks|

Relying on the Metrics of Evaluated Agents

Visiting speaker
Hybrid
Past Talk
Serena Wang
Postdoc, Harvard
Jan 16, 2026
2:00 pm
EST
Jan 16, 2026
2:00 pm
In-person
Portsoken Street
London, E1 8PH, UK
The Roux Institute
Room
100 Fore Street
Portland, ME 04101
Network Science Institute
2nd floor
Network Science Institute
11th floor
177 Huntington Ave
Boston, MA 02115
Network Science Institute
2nd floor
Room
58 St Katharine's Way
London E1W 1LP, UK
Register for talk
Register for talk

Talk recording

Developers and regulators of online platforms and AI systems face a continuing problem of designing effective evaluation metrics. While tools for collecting and processing data continue to progress, this has not addressed the problem of "unknown unknowns", or fundamental informational limitations on part of the evaluator. To guide the choice of metrics in the face of this informational problem, we turn to the evaluated agents themselves, who may have more information about how to measure their own outcomes. This talk will cover a theoretical model of this interaction as a principal-agent game, in which we ask: "When does an agent have an incentive to reveal the observability of a metric to their evaluator?"
About the speaker
Serena Wang is a postdoc at Harvard, and will be joining the University of British Columbia as an Assistant Professor in Computer Science in 2026. She has also worked with Google Research at 20% time. Her research focuses on understanding and improving the long term societal impacts of AI by rethinking algorithms and their surrounding incentives and practices. Her recent work concerns evaluation processes for AI systems and beyond, including how to discover new metrics, how to mitigate gaming, and how to think about representation and fairness.
Share this page:
Jan 16, 2026