The Evaluation Crisis: We Do Not Know How Good Our Models Actually Are cover art

The Evaluation Crisis: We Do Not Know How Good Our Models Actually Are

The Evaluation Crisis: We Do Not Know How Good Our Models Actually Are

Listen for free

View show details

MMLU is saturated. Chatbot Arena is gameable. Public benchmarks leak into training data. The only eval that matters is the one you build yourself, on your data, for your task.

adbl_web_anon_alc_button_suppression_t1
No reviews yet