BenchMIRT: What are LLM benchmarks actually measuring?
BenchMIRT is a new method for auditing LLM benchmarks question by question, revealing which capabilities they actually measure and helping researchers build smaller, more focused, and easier-to-interpret evaluations.
Ai2 Blog··Updated just now·38 sightings