Fused LLM rankings: one IRT/Elo scale across ~5,000 public benchmark leaderboards, updated daily. Connect the official The Aggregate — LLM benchmark aggregate MCP server to Claude, ChatGPT, or Cursor through gate — one gateway URL, no config files, security-checked.
Free to start · No credit card · No hosting needed
Pick your client. Copy, paste, done — or let gate handle sign-ins and policies for you.
claude mcp add --transport http the-aggregate-llm-benchmark-aggregate https://theaggregate.ai/mcpRun in your terminal, then restart Claude Code.
The Aggregate — LLM benchmark aggregate · https://theaggregate.ai/mcp
Real prompts you can type the moment it's connected — no setup, no docs to read.
“Use “get_leaderboard”: Top of the cross-benchmark aggregate ranking: every model placed on one Elo scale by an IRT model fit over ~5,000 public benchmark leaderboa.”
“Use “search_models”: Find ranked models by (partial) name or provider. Returns rank, Elo and the model page URL. One row per model by default, fused across reaso.”
“Use “get_model”: One model in depth: aggregate rank, Elo with standard error, provider, what it is, cost per task where known, and its most notable benchmark.”
“Use “compare_models”: Head-to-head between 2-4 models: aggregate ranks, Elo gap with a significance note based on the standard errors, and notable benchmarks they.”
Every server in the gate directory has to pass the same four checks before your AI can touch it. Here's how The Aggregate — LLM benchmark aggregate holds up.
Operated by The Aggregate — LLM benchmark aggregate (theaggregate.ai) at its documented MCP endpoint — not a third-party mirror or community re-host.
This server only exposes public data — no account and no credentials are involved when you connect.
gate checks every tool for prompt injection, hidden instructions, data-exfiltration hints, and over-broad permissions before the server is available through your gateway.
If The Aggregate — LLM benchmark aggregate adds or changes tools later, gate re-scans and alerts you — before your AI acts on the change.
Add one gateway URL to Claude, ChatGPT, or any MCP client. One-time setup, about two minutes.
Choose The Aggregate — LLM benchmark aggregate in the gate directory. No sign-in needed.
The Aggregate — LLM benchmark aggregate's tools are live in every AI client you've connected — with rules and logging built in.
Free to start · No credit card · No hosting needed
Fetched live from the official endpoint and re-checked daily by gate — not marketing copy.
get_leaderboard — Top of the cross-benchmark aggregate ranking: every model placed on one Elo scale by an IRT model fit over ~5,000 public benchmark leaderboa
search_models — Find ranked models by (partial) name or provider. Returns rank, Elo and the model page URL. One row per model by default, fused across reaso
get_model — One model in depth: aggregate rank, Elo with standard error, provider, what it is, cost per task where known, and its most notable benchmark
compare_models — Head-to-head between 2-4 models: aggregate ranks, Elo gap with a significance note based on the standard errors, and notable benchmarks they
search_benchmarks — Find benchmarks in the aggregate by (partial) name. Returns model coverage, difficulty on the Elo scale, and the benchmark page URL.
get_benchmark — One benchmark in depth: what it measures, the original source leaderboard URL, IRT stats (difficulty, noise, model coverage), skill weights,
get_prediction_duel — Guesswork — the public prediction duel: every day frontier LLMs and The Aggregate's own IRT model predict newly scraped benchmark scores bef
about_the_aggregate — What this data is: how the IRT fusion works, current coverage counts, update cadence, and how to cite it.
https://theaggregate.ai/mcpYes — The Aggregate — LLM benchmark aggregate operates its own remote MCP server at theaggregate.ai. gate connects you to that official endpoint and adds security scanning, per-tool access rules, and an activity log on top.
Add gate's gateway URL to your AI client once, then pick The Aggregate — LLM benchmark aggregate in the directory. No account or sign-in is needed. From then on, The Aggregate — LLM benchmark aggregate's tools are available in every client you've connected to gate.
No. The Aggregate — LLM benchmark aggregate runs the server, and gate is fully managed. You just connect one URL — there's nothing to install, deploy, or maintain.
It's the vendor's official endpoint, and gate scans its tools for prompt injection and hidden instructions before it goes live, re-checks it whenever it changes, and lets you allow, block, or require approval for every single tool.
Yes — you can get started with gate for free and connect The Aggregate — LLM benchmark aggregate in minutes. No credit card required.
Every server below works through the same gateway URL — connect once, add tools anytime.
Set up The Aggregate — LLM benchmark aggregate in: Claude · Claude Code · ChatGPT · Cursor · VS Code
One URL. All MCPs. Full control. Free to start.
Get started free