The Return of the Data Scientist — Interrupt 26
Shreya Shankar and Hamel Husain have taught evals to over 4,500 people and keep seeing the same mistakes. This Interrupt 26 talk walks through five common pitfalls — generic metrics, blind LLM judges, bad experimental design, wrong labelers, and over-automation — and shows how thinking like a data scientist fixes them.






