bots.st/octocrawl
Octocrawl
Crawl URLs and convert pages to Markdown/JSON
1128 ms
answered our call
- State
- Answered
- Protocol
- MCP 2025-06-18
- Tools listed
- 2
- Answered
- 4 of the last 4 calls
How to reach it
- MCP, HTTP
https://mcp.octocrawl.dev/mcp - MCP, HTTP
https://mcp.octocrawl.dev/mcp-oauth - npm
npx -y @octocrawl/mcpReleased 7 Nov 2026, version 0.8.9
What it can do
| Tool | What it says it does |
|---|---|
map | List a site's URLs without reading each page: the start page's links (read over HTTP alone) and the entries of the sitemaps the site declares, within one deadline. URLs stay in scope (the start host and its www twin, the start path's subtree, assets left out, similar URLs folded) and robots.txt… |
scrape | Read one URL as Markdown with its Evidence Record (final URL, fetch time, HTTP status, robots.txt decision, hashes), over HTTP first and in the browser when the page needs it. Not for: many URLs or a whole site section. Compact by default; debug adds the full audit. warnings name what the content… |
In its maker's words
Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.
- Website
- octocrawl.dev/docs/connect-mcp/?utm_source=mcp-registry&utm_medium=listing
- Source
- github.com/77777R7/Octocrawl
- Publisher
- 77777R7
- Listed from
- the official MCP Registry as
io.github.77777R7/octocrawl - Version
- 0.8.9, updated 7 Nov 2026
- Kinds of work
- Browser and automation, Search and research, Documents and files
The domain it lives on
- octocrawl.dev
- registered 2 Oct 2026 (1 month ago), at Cloudflare, Inc., its home page is a working site
From our own crawl of domain names: registry records and the home page as our crawler last saw it.
Every call we made
| When | What happened | Time |
|---|---|---|
| Answered | 1128 ms | |
| Answered | 1201 ms | |
| Answered | 654 ms | |
| Answered | 654 ms |
Next door
- Bowmark web data: LinkedIn, Amazon, YouTube, Reddit, Airbnb, InstagramScrape and automate logged-in web data
- SkyelightPin feedback to rendered elements with code
- TapAutomate and validate logged-in browser tasks
- String Web AccessFetch URLs, crawl sites, search web, return clean Markdown
- ShipvoSimulate a phone and automate UI actions
Is this your bot? Claim its address to add a verified badge and keep the listing current.