← Engineering

Stop trusting LLM leaderboards. Pick a model on your own workload.

June 8, 2026 · Dynoyard

Every week a new model “tops the benchmarks.” Every week someone rewrites their stack chasing it. Most of that churn is wasted — because a leaderboard score is a poor predictor of how a model performs on your task.

Here’s a more reliable way to choose.

Why leaderboards mislead

Public benchmarks are useful signal, but they’re easy to over-trust:

  • They’re task-distributions, not your task. SWE-Bench measures one thing; your codebase, your prompts, your tools are another. A model that’s #1 on a benchmark can be middling on your domain — and vice versa.
  • They’re gameable and saturating. Once a benchmark matters commercially, results cluster at the top and the differences get noisy.
  • They go stale fast. Models update monthly. Any ranking you read is already drifting.
  • They ignore the axes you actually pay for — latency, throughput, cost per task, and how the model behaves inside your harness (tool-calling format, streaming behavior, refusal patterns).

None of that means benchmarks are useless. It means they’re a starting filter, not a decision.

The two things that are actually objective

When you strip out the subjective “which is smarter” debate, two things you can measure cleanly remain:

  1. Cost per unit of work. Token prices are public. The spread is enormous — frontier open-weight models often run roughly an order of magnitude cheaper than the closed flagships for comparable tasks. That’s not an opinion; it’s arithmetic.
  2. Accuracy on your workload. Not a benchmark’s — yours. The only quality number that matters is the one measured on the prompts you actually send.

Optimize for those two and the “best model” debate mostly dissolves.

A 30-minute model bake-off

You don’t need a research rig. You need a representative sample of your own traffic.

  1. Pull 20–50 real requests from your logs — a spread of easy, hard, and weird ones. These are your eval set. Nothing synthetic.
  2. Run them through 3–4 candidate models, unchanged. Same prompts, same tools, same harness.
  3. Score what you care about. For code: does it compile / pass tests / apply cleanly? For agents: did it call the right tool with valid args? For extraction: is the JSON right? Use a rubric, or an LLM-as-judge if the task is fuzzy — but score outcomes, not vibes.
  4. Record the cost and latency of each run alongside the score. Most “good enough at a tenth the price” wins hide here.
  5. Pick on the curve, not the peak. The right model is usually the cheapest one that clears your quality bar — not the highest absolute score. A model that’s 2% better and 8× pricier rarely earns it.

Re-run this quarterly. Models move; your eval set keeps you honest.

What makes this easy (or painful)

The friction in a bake-off is almost never the scoring — it’s the plumbing. If trying a new model means a new account, new SDK, new billing, and a new auth flow, you’ll test one model and call it a day.

It’s far easier when every model sits behind one OpenAI-compatible endpoint: you swap a single string (model="..."), keep your SDK, and compare on identical code. That’s the whole reason a unified gateway exists — not to tell you which model is best, but to make finding out for yourself a 30-minute job instead of a 3-day integration.

The bias worth disclosing: we build one. We’re not going to tell you a winner — we’d rather you A/B it, because on cost-per-task, cheap open models tend to surprise people. Run the bake-off and trust your own numbers.

The takeaway

Don’t pick a model from a leaderboard. Pick it from your eval set, your cost, your latency. Benchmarks narrow the field; your own traffic decides. The cheapest model that clears your bar is almost always the right answer — and the only way to know which one that is, is to run your own prompts through all of them.

Every model behind one OpenAI-compatible endpoint. Run your own bake-off.