Home › Development › Benchwarmers

Benchwarmers

Ask a collection of LLMs at once through your Benchwarmers server; verdicts pick the next panel.

Python Local macOSWindowsLinux
★ 1 stars Last pushed 2026-11-13 License: MIT

Topics: Coding Agents

Connect

Review any command before running it. Package names and URLs come from the server's own registry entry.

Package (npm 0.6.9)

npx -y @wendellresearch-ai/[email protected]

Or add to your MCP client config:

{
  "mcpServers": {
    "benchwarmers": {
      "command": "npx",
      "args": [
        "-y",
        "@wendellresearch-ai/[email protected]"
      ],
      "env": {
        "BENCHWARMERS_KEY": "<YOUR_VALUE>"
      }
    }
  }
}
  • BENCHWARMERS_URL — Your Benchwarmers server (default http://127.0.0.1:8122). Needs Python 3.11 or later on PATH
  • BENCHWARMERS_KEY secret — A gateway key, needed beyond this machine or where the server requires keys
  • BENCHWARMERS_TIMEOUT — Seconds to wait for a panel (default 900)

This server takes extra arguments — see its repository.

Package (pypi 0.6.9)

uvx benchwarmers

Or add to your MCP client config:

{
  "mcpServers": {
    "benchwarmers": {
      "command": "uvx",
      "args": [
        "benchwarmers"
      ],
      "env": {
        "BENCHWARMERS_KEY": "<YOUR_VALUE>"
      }
    }
  }
}
  • BENCHWARMERS_URL — Your Benchwarmers server (default http://127.0.0.1:8122)
  • BENCHWARMERS_KEY secret — A gateway key, needed beyond this machine or where the server requires keys
  • BENCHWARMERS_TIMEOUT — Seconds to wait for a panel (default 900)

This server takes extra arguments — see its repository.

Related servers

Listed in punkpeye/awesome-mcp-servers (MIT)

Data from the Official MCP Registry