bots.st/agentwebmap
agentwebmap
Validate and map publisher documentation
3335 ms
answered our call
- State
- Answered
- Protocol
- MCP 2025-06-18
- Tools listed
- 24
- Answered
- 3 of the last 3 calls
How to reach it
- MCP, HTTP
https://agentwebmap.com/mcp
What it can do
| Tool | What it says it does |
|---|---|
audit_website | Requires tools:run via a free integration key or OAuth. Read a bounded public snapshot of homepage delivery, llms.txt, robots access for search and training crawlers, and static interface hints. This does not render JavaScript, establish WebMCP tools, confirm indexing, measure AI citations or… |
begin_ownership_claim | Start optional ownership management or recovery for a domain you control. Returns an expiring fresh public proof token and a private claim_secret shown once. Keep the secret private; publish only the verification snippet, then call verify_domain with claim_id and claim_secret. Existing keys remain… |
check_llms_txt | Validate a site's llms.txt: reachability, HTML-instead-of-text, redirects to other domains, H1 title, summary, sections, links, link health, llms-full.txt and charset. Returns each check with what to fix and the file preview. Ownership management is optional and does not affect validation. |
check_mcp_endpoint | Requires tools:run via a free account integration key or OAuth. Inspect a public HTTPS MCP endpoint tool inventory and authentication response. No credentials, query strings, private addresses, redirects, schema-reference resolution or service-tool execution. Results describe observed metadata… |
directory_stats | Directory-wide counts for Agent Web Map: domains tracked, valid llms.txt files, listed, verified, pending. |
explore_sections | Explore relationships between publisher headings. Edges count distinct listed sites sharing both labels. Pass section keys to return related labels and a bounded page of publishers; no sections returns aggregate clusters only. Discovery is monitored without automatic usage quotas. |
generate_llms_txt | Draft an llms.txt from a bounded crawl of a publisher’s public pages, sitemaps and documentation links. Uses observed headings, descriptions and page content, respects robots rules, and reports partial coverage. The owner reviews the editable file before publishing at /llms.txt. Website ownership… |
list_categories | List topic taxonomy and counts by inferred category and agentic label, unclassified sites and publisher-declared MCP endpoints. Categories describe topics; capabilities are separate explicit publisher declarations. Counts can overlap. Use category or capability filters with resolve… |
list_countries | List country codes and names with valid listed-site counts, plus the unknown count. Use country=FR or country=unknown with resolve, search_llms_registry, list_domains, list_sections and explore_sections. Owner-declared or site-published addresses are preferred; domain/hosting inference is a… |
list_domains | Ranked listing of the directory (verified first, then authority). Use verified_only to get only owner-verified sites. |
list_sections | Discover publisher section labels across the indexed corpus, distinct-site counts, newly observed labels, conservative emerging signals and seven-day membership changes. Emerging requires ten estimated domain-name families, excludes known templates/duplicates and waits three days; this measures… |
lookup_domain | Look up a domain: source URLs, summary, authority, ownership verification, inferred country, last check and owner-stated terms. Compact by default; detail=full adds profile, nested files, badge and ownership claim instructions. |
read_llms_txt | Return our validated copy of a listed site's llms.txt as text, with its source URL, check date and content hash. No second fetch needed, and it works when the publisher blocks automated clients. A site not cached yet is fetched once on demand. |
recrawl_site | Verified owner only. Re-validate and update the directory listing now (once per 10 minutes). This crawl can change listing and ownership verification state. Review the result and return to the owner dashboard for activity and history. |
register_domain | Submit a public domain or announce a file update to queue a live crawl, including previously invalid tracked domains. Same-domain requests are coalesced with a ten-minute cooldown. Existing listings stay visible until checked; queueing does not guarantee listing or prove ownership. Returns reason… |
resolve | Start here to find documentation for a domain or development task. Returns specific page URLs with publisher excerpts, matching evidence, owner-stated terms, freshness and alternatives. A named publisher stays scoped to its valid documentation or known replacement. No usable publisher or… |
rotate_owner_key | Owner only. Replace the API key and invalidate all existing browser owner sessions. Keep the new key; it is shown once. Does not require changing the existing ownership proof. |
search_llms_registry | Search domains and indexed documentation links by words and meaning. Relevance ranks before authority and ownership verification, with keyword fallback if semantic search is unavailable. Compact results omit owner claims by default; use detail=full for profile metadata. |
similar_sites | Find related listed publishers by vector similarity to a known domain. Returns compact profiles, cosine similarity and actual shared section keys. Similarity is not affiliation, endorsement or proof of equivalent capabilities. Uses stored vectors without a paid call per request; unavailable or… |
site_stats | Verified owner only. Review measured website, REST and MCP requests, daily activity, documentation selections, publisher clicks, file health and the last 30 score snapshots. Counts include bots, tests and repeated requests; they do not identify unique agents or confirm publisher page reads. |
update_site | Verified owner only. Control the listing profile (description, agent_summary, tags, nested llms.txt paths, contact, owner-declared publisher_country) and terms for agents (agent_terms: automated_access = one of welcome | limited | ask | not_allowed: may agents use the site automatically?… |
validate_llms_txt | Check a pasted llms.txt draft in memory. Required format is separate from writing recommendations. No links are fetched, no text is saved and nothing is published. |
verification_instructions | Describe optional ownership management and its four proof methods. Call begin_ownership_claim to obtain a fresh expiring proof and a private claim secret. No ownership claim is needed for discovery. |
verify_domain | Complete the fresh challenge from begin_ownership_claim using its private claim credentials. Checks the published proof and consumes the challenge once, returning the owner API key shown once. Public or legacy proof tokens alone cannot issue keys. Recovery replaces previous credentials and… |
In its maker's words
Find publisher documentation via llms.txt, with source links, evidence and check dates.
- Website
- agentwebmap.com
- Source
- github.com/AgentWebMap/mcp
- Publisher
- agentwebmap.com
- Listed from
- the official MCP Registry as
com.agentwebmap/agentwebmap - Version
- 0.8.2, updated 19 Oct 2026
- Kinds of work
- Domains and websites, AI models and agent tools, Law, tax and government
The domain it lives on
- agentwebmap.com
- registered 13 Aug 2026 (3 months ago), at https://www.101domain.com/
From our own crawl of domain names: registry records and the home page as our crawler last saw it.
Every call we made
| When | What happened | Time |
|---|---|---|
| Answered | 3335 ms | |
| Answered | 3397 ms | |
| Answered | 1689 ms |
Next door
Is this your bot? Claim its address to add a verified badge and keep the listing current.