Home › Browser Automation & Scraping › Octocrawl

Octocrawl

Web pages as clean Markdown and JSON for AI agents, in fewer tokens, with an Evidence Record.

Official TypeScript CloudLocal macOSWindowsLinux Remote

★ 2 stars Last pushed 2026-10-31 License: AGPL-3.0

View repository → Website →

Connect

Review any command before running it. Package names and URLs come from the server's own registry entry.

Remote (streamable-http)

https://mcp.octocrawl.dev/mcp Reachable (checked 2026-10-30)

Claude Code:

claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp

Or add to your MCP client config:

{
  "mcpServers": {
    "octocrawl": {
      "url": "https://mcp.octocrawl.dev/mcp"
    }
  }
}

Remote (streamable-http)

https://mcp.octocrawl.dev/mcp-oauth Requires auth (checked 2026-10-30)

Claude Code:

claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp-oauth

Or add to your MCP client config:

{
  "mcpServers": {
    "octocrawl": {
      "url": "https://mcp.octocrawl.dev/mcp-oauth"
    }
  }
}

Package (npm 0.7.0)

npx -y @octocrawl/[email protected]

Or add to your MCP client config:

{
  "mcpServers": {
    "octocrawl": {
      "command": "npx",
      "args": [
        "-y",
        "@octocrawl/[email protected]"
      ],
      "env": {
        "W2L_API_URL": "<YOUR_VALUE>",
        "W2L_API_TOKEN": "<YOUR_VALUE>",
        "W2L_MCP_TOOLSETS": "<YOUR_VALUE>",
        "W2L_MCP_READ_ONLY": "<YOUR_VALUE>"
      }
    }
  }
}

W2L_API_URL — The Octocrawl API the server calls: npx octocrawl serve on this computer (default http://127.0.0.1:8787), or https://api.octocrawl.dev
W2L_API_TOKEN secret — A bearer token for a hosted or self-hosted API; none for a local one
W2L_MCP_TOOLSETS — The tool groups to list, comma-separated: core, crawl, batch, products, logins, monitor, delivery, or all (default all); the same as --toolsets
W2L_MCP_READ_ONLY — 1 lists read-only tools alone, with a scrape that does not act as the person; the same as --read-only