bots.st/rat-radar
Rat Radar
Robots and scraping permission checks
2524 ms
answered our call
- State
- Answered
- Protocol
- MCP 2025-06-18
- Tools listed
- 8
- Answered
- 3 of the last 3 calls
How to reach it
- MCP, HTTP
https://rat-radar.github-a18.workers.dev/mcp
What it can do
| Tool | What it says it does |
|---|---|
can_fetch | Does robots.txt allow fetching this exact URL? Fetches the live robots.txt and applies the longest-match rule for a user agent (default: * plus GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot). Returns allowed or not, the rule that decided it, and any crawl delay. A courtesy check, not a… |
check_site | Can I scrape this site, and how? Returns a verdict (open, guarded, hostile, blocked), a hostility score, a recommended approach with steps and risks, bot protections, robots.txt and AI-crawler policy, machine-readable surfaces (sitemap, llms.txt, JSON-LD), and eu_ai_training: the signals the EDPB… |
get_playbook | What should I build with this site, and how? Give a domain and, optionally, a goal in plain words (for example "price alerts", "sales leads", "new jobs", "change log", "knowledge base"). Returns the best-matching workflow for that site: what it does, its cadence, a trigger, collect, shape, store… |
list_sites | List the sites in the dataset, optionally by category or verdict. Use it to find easy targets or to see what is covered. |
search_sites | Find sites in the dataset by a word: a name, host, category (jobs, shop, news, gov), country or verdict. Use it to discover what is covered before calling check_site. |
summary | Headline numbers across the dataset: verdict mix, how many sites block AI crawlers (and which), protection vendors, by category and country. |
xray_diagram | Draw a page's anatomy as an Excalidraw diagram: its regions, the ranked ways to get its data, proof rows, the best route and what the page is made of. Returns a download link for the .excalidraw file (give it to the user; it opens at excalidraw.com or in Obsidian) and a file_name. With… |
xray_page | How do I extract the data from THIS page? Fetches one public page and returns a ranked extraction plan: embedded JSON, JSON-LD, repeated records with CSS selectors and field names, tables, feeds, hidden API calls. Each source has a reliability, proof rows pulled from the real page, and the plan… |
In its maker's words
Ask before you scrape: is a site open, may I fetch this URL, and how do I extract a page. No key.
- Website
- ratlabs.tech/radar
- Publisher
- ratlabs.tech
- Listed from
- the official MCP Registry as
tech.ratlabs/rat-radar - Version
- 1.4.0, updated 28 Oct 2026
- Kinds of work
- Search and research, Browser and automation, Security and trust
The domain it lives on
- ratlabs.tech
- registered 18 Apr 2026 (7 months ago), at NameCheap, Inc., its home page is a working site
From our own crawl of domain names: registry records and the home page as our crawler last saw it.
Every call we made
| When | What happened | Time |
|---|---|---|
| Answered | 2524 ms | |
| Answered | 2453 ms | |
| Answered | 927 ms |
Next door
Is this your bot? Claim its address to add a verified badge and keep the listing current.