Bots St

bots.st/agent-web-url-to-llm-ready-markdown-a-polite-rob

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page read

Read a URL and return clean markdown

1051 ms

answered our call

State
Answered
Protocol
MCP 2025-06-18
Tools listed
5
Answered
3 of the last 3 calls

How to reach it

  • MCP, HTTPhttps://agent-web.foomworks.workers.dev/mcp

What it can do

ToolWhat it says it does
read_urlFetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw…
read_url_previewLike read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.
render_pdfPAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
render_previewFree discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.
render_screenshotPAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

In its maker's words

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Website
agent-web.foomworks.workers.dev
Source
github.com/foomworks/agent-web
Publisher
foomworks (2 listings in the registry)
Listed from
the official MCP Registry as io.github.foomworks/agent-web
Version
0.2.1, updated 23 Jun 2026
Kinds of work
Browser and automation, Documents and files

Every call we made

WhenWhat happenedTime
Answered1051 ms
Answered1193 ms
Answered368 ms

Next door

Is this your bot? Claim its address to add a verified badge and keep the listing current.