Every new AI model shows up with a chart of test scores. The problem is that models learn from the internet, and the internet is full of test questions (and their answers). LiveBench is a Benchmark built to get around that by never sitting still.
It’s also, lately, how people keep score in the U.S. versus China AI race. Which is a lot of weight for one website to carry.
What it means
LiveBench is a public scoreboard for AI models that refreshes its questions regularly, pulling from recent sources like new research papers, news articles, and movie summaries. Answers get graded automatically against known right answers, not by another AI or a person. The “live” part is the point. The test keeps changing, and you can look at the current leaderboard yourself at livebench.ai. It covers six areas: math, coding, reasoning, language, following instructions, and data analysis.
Why it matters
It’s built to stop cheating, including the accidental kind. If a test’s questions end up in a model’s training data, a high score might just mean the model memorized them. Researchers call that contamination. Fresh questions make it a lot harder. Older benchmarks can’t really fix this once their questions are public, and most of them are.
It has serious names behind it. The original paper came out in June 2024 from researchers at Abacus.AI, NYU, Nvidia, and several universities, with Yann LeCun among the authors. When it launched, even the top models scored below 70%. It was later picked as a spotlight paper at ICLR 2025, one of the bigger AI research conferences.
It’s turned into a geopolitical scoreboard. In an October 4, 2026 snapshot, DeepSeek’s V4.1 Flash scored 81.1 to Anthropic’s top model’s 83.4, a gap of about 3%. That’s where all the “3%” headlines came from. A Bloomberg Intelligence analyst pointed out DeepSeek actually led on agentic coding, and also cautioned that scores “do not establish national AI leadership.” Fair enough. People are gonna use them that way anyway.
Simple example
A driving instructor uses the same five-street route for every road test. After a few years, students show up having practiced those exact five streets, every turn, every stop sign.
They pass. Some of them have never merged onto a highway. A few have never parallel parked.
LiveBench is the instructor who picks a new route every month and doesn’t tell anybody where it goes.