LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key. Connect the official IA-QA Eval & RAG — 38 tools MCP server to Claude, ChatGPT, or Cursor through gate — one gateway URL, no config files, security-checked.
Free to start · No credit card · No hosting needed
Pick your client. Copy, paste, done — or let gate handle sign-ins and policies for you.
claude mcp add --transport http ia-qa-eval-rag-38-tools https://www.ia-qa.com/mcp/evalRun in your terminal, then restart Claude Code.
IA-QA Eval & RAG — 38 tools · https://www.ia-qa.com/mcp/eval
Real prompts you can type the moment it's connected — no setup, no docs to read.
“Use “get_testing_guidelines”: Query the IA-QA methodology knowledge base. Returns structured testing guidelines, assertion strategies, thresholds, best practices, and rel.”
“Use “find_tool”: Search available MCP tools by keyword or category before calling them. Returns matching tool names, descriptions, and optionally their input.”
“Use “hallucination_check”: Lexical hallucination check: verifies an LLM answer's words, numbers and polarity against the provided source/context. Fast, deterministic,.”
“Use “run_eval_contract”: Parse a .ia-eval.yaml LLM test suite, call the specified LLM model for each scenario, run all configured scorers, and return a structured JS.”
Every server in the gate directory has to pass the same four checks before your AI can touch it. Here's how IA-QA Eval & RAG — 38 tools holds up.
Operated by IA-QA Eval & RAG — 38 tools (ia-qa.com) at its documented MCP endpoint — not a third-party mirror or community re-host.
This server only exposes public data — no account and no credentials are involved when you connect.
gate checks every tool for prompt injection, hidden instructions, data-exfiltration hints, and over-broad permissions before the server is available through your gateway.
If IA-QA Eval & RAG — 38 tools adds or changes tools later, gate re-scans and alerts you — before your AI acts on the change.
Add one gateway URL to Claude, ChatGPT, or any MCP client. One-time setup, about two minutes.
Choose IA-QA Eval & RAG — 38 tools in the gate directory. No sign-in needed.
IA-QA Eval & RAG — 38 tools's tools are live in every AI client you've connected — with rules and logging built in.
Free to start · No credit card · No hosting needed
Fetched live from the official endpoint and re-checked daily by gate — not marketing copy.
get_testing_guidelines — Query the IA-QA methodology knowledge base. Returns structured testing guidelines, assertion strategies, thresholds, best practices, and rel
find_tool — Search available MCP tools by keyword or category before calling them. Returns matching tool names, descriptions, and optionally their input
hallucination_check — Lexical hallucination check: verifies an LLM answer's words, numbers and polarity against the provided source/context. Fast, deterministic,
run_eval_contract — Parse a .ia-eval.yaml LLM test suite, call the specified LLM model for each scenario, run all configured scorers, and return a structured JS
run_semantic_tests — Semantic assertion primitive: compare actual vs expected text pairs using cosine similarity + ROUGE-L. Two modes: tfidf (default, free, no A
generate_ci_workflow — Generate a ready-to-commit GitHub Actions workflow that gates a build on IA-QA. Two gate types, combinable: "eval_contract" runs a .ia-eval.
needle_haystack_generate — Generate a "needle in a haystack" test: embeds a target fact into a large block of filler text at a specified position. Use this to test LLM
generate_eval_yaml — Generate a complete .ia-eval.yaml evaluation contract from a plain-language description of what your LLM should do. Uses Groq openai/gpt-oss
+ 30 more tools once connected
https://www.ia-qa.com/mcp/evalYes — IA-QA Eval & RAG — 38 tools operates its own remote MCP server at www.ia-qa.com. gate connects you to that official endpoint and adds security scanning, per-tool access rules, and an activity log on top.
Add gate's gateway URL to your AI client once, then pick IA-QA Eval & RAG — 38 tools in the directory. No account or sign-in is needed. From then on, IA-QA Eval & RAG — 38 tools's tools are available in every client you've connected to gate.
No. IA-QA Eval & RAG — 38 tools runs the server, and gate is fully managed. You just connect one URL — there's nothing to install, deploy, or maintain.
It's the vendor's official endpoint, and gate scans its tools for prompt injection and hidden instructions before it goes live, re-checks it whenever it changes, and lets you allow, block, or require approval for every single tool.
Yes — you can get started with gate for free and connect IA-QA Eval & RAG — 38 tools in minutes. No credit card required.
Every server below works through the same gateway URL — connect once, add tools anytime.
Set up IA-QA Eval & RAG — 38 tools in: Claude · Claude Code · ChatGPT · Cursor · VS Code
One URL. All MCPs. Full control. Free to start.
Get started free