Bots St

bots.st/rat-radar

Rat Radar

Robots and scraping permission checks

2524 ms

answered our call

State
Answered
Protocol
MCP 2025-06-18
Tools listed
8
Answered
3 of the last 3 calls

How to reach it

  • MCP, HTTPhttps://rat-radar.github-a18.workers.dev/mcp

What it can do

ToolWhat it says it does
can_fetchDoes robots.txt allow fetching this exact URL? Fetches the live robots.txt and applies the longest-match rule for a user agent (default: * plus GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot). Returns allowed or not, the rule that decided it, and any crawl delay. A courtesy check, not a…
check_siteCan I scrape this site, and how? Returns a verdict (open, guarded, hostile, blocked), a hostility score, a recommended approach with steps and risks, bot protections, robots.txt and AI-crawler policy, machine-readable surfaces (sitemap, llms.txt, JSON-LD), and eu_ai_training: the signals the EDPB…
get_playbookWhat should I build with this site, and how? Give a domain and, optionally, a goal in plain words (for example "price alerts", "sales leads", "new jobs", "change log", "knowledge base"). Returns the best-matching workflow for that site: what it does, its cadence, a trigger, collect, shape, store…
list_sitesList the sites in the dataset, optionally by category or verdict. Use it to find easy targets or to see what is covered.
search_sitesFind sites in the dataset by a word: a name, host, category (jobs, shop, news, gov), country or verdict. Use it to discover what is covered before calling check_site.
summaryHeadline numbers across the dataset: verdict mix, how many sites block AI crawlers (and which), protection vendors, by category and country.
xray_diagramDraw a page's anatomy as an Excalidraw diagram: its regions, the ranked ways to get its data, proof rows, the best route and what the page is made of. Returns a download link for the .excalidraw file (give it to the user; it opens at excalidraw.com or in Obsidian) and a file_name. With…
xray_pageHow do I extract the data from THIS page? Fetches one public page and returns a ranked extraction plan: embedded JSON, JSON-LD, repeated records with CSS selectors and field names, tables, feeds, hidden API calls. Each source has a reliability, proof rows pulled from the real page, and the plan…

In its maker's words

Ask before you scrape: is a site open, may I fetch this URL, and how do I extract a page. No key.

Website
ratlabs.tech/radar
Publisher
ratlabs.tech
Listed from
the official MCP Registry as tech.ratlabs/rat-radar
Version
1.4.0, updated 28 Oct 2026
Kinds of work
Search and research, Browser and automation, Security and trust

The domain it lives on

ratlabs.tech
registered 18 Apr 2026 (7 months ago), at NameCheap, Inc., its home page is a working site

From our own crawl of domain names: registry records and the home page as our crawler last saw it.

Every call we made

WhenWhat happenedTime
Answered2524 ms
Answered2453 ms
Answered927 ms

Next door

Is this your bot? Claim its address to add a verified badge and keep the listing current.