Robots.txt & Sitemap
A site's robots.txt rules per user agent, whether AI crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot) are blocked, and the URLs listed in its sitemap. Use before crawling a site or for SEO audits.
The wallet the 402 directs payment to. Its whole payment record — every payer, every chain — is on the merchant page.
Asset 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913
The payTo wallet does not resolve to a registered ERC-8004 agent. That is not a verdict on the service — most of the catalog is unregistered.
Accepts
The payment requirements as published to the catalog. Read the live 402 before paying — a price here is a claim, not a quote.
Pay 0.002 USDC on Base to 0x1129…e1871. The signed payment is good for 5 minutes.
- Paid to
- 0x1129…e1871
- USD Coin contract
- 0x8335…02913
- Payment window
- 5 minutes
- As published
- 2000 smallest units
That figure is in the token’s smallest units. Roundhouse does not hold this contract’s decimals, so it is shown as published rather than converted.
- Paid to
- 0x1129…e1871
- Token contract
- 0x3c49…c3359
- Payment window
- 5 minutes
That figure is in the token’s smallest units. Roundhouse does not hold this contract’s decimals, so it is shown as published rather than converted.
- Paid to
- 0x1129…e1871
- Token contract
- 0xaf88…e5831
- Payment window
- 5 minutes
The catalog’s raw entry
[
{
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"extra": {
"name": "USD Coin",
"version": "2"
},
"payTo": "0x1129A6BB9C6165FF07fdC509c107B522CA0e1871",
"amount": "2000",
"scheme": "exact",
"network": "eip155:8453",
"maxTimeoutSeconds": 300
},
{
"asset": "0x3c499c542cEF5E3811e1192ce70d8cC03d5c3359",
"extra": {
"name": "USD Coin",
"version": "2"
},
"payTo": "0x1129A6BB9C6165FF07fdC509c107B522CA0e1871",
"amount": "2000",
"scheme": "exact",
"network": "eip155:137",
"maxTimeoutSeconds": 300
},
{
"asset": "0xaf88d065e77c8cC2239327C5EDb3A432268e5831",
"extra": {
"name": "USD Coin",
"version": "2"
},
"payTo": "0x1129A6BB9C6165FF07fdC509c107B522CA0e1871",
"amount": "2000",
"scheme": "exact",
"network": "eip155:42161",
"maxTimeoutSeconds": 300
}
]Extensions
{
"bazaar": {
"info": {
"input": {
"type": "http",
"method": "GET",
"queryParams": {
"limit": 20,
"domain": "stripe.com"
}
},
"output": {
"type": "json",
"example": {
"rules": {
"*": {
"allow": [
"/docs",
"/docs$"
],
"disallow": [
"/bitcoin/refund",
"/sources/refund"
],
"crawl_delay": null
},
"rogerbot": {
"allow": [],
"disallow": [],
"crawl_delay": "2"
},
"ia_archiver": {
"allow": [
"/docs/api",
"/docs/api$"
],
"disallow": [
"/docs",
"/docs$"
],
"crawl_delay": null
}
},
"domain": "stripe.com",
"sitemaps": [
"https://stripe.com/sitemap/sitemap.xml"
],
"ai_crawlers": {
"CCBot": "default",
"GPTBot": "default",
"ClaudeBot": "default",
"Bytespider": "default",
"ChatGPT-User": "default",
"anthropic-ai": "default",
"PerplexityBot": "default",
"Google-Extended": "default",
"Applebot-Extended": "default"
},
"sitemap_urls": [],
"sitemaps_read": [
"https://stripe.com/sitemap/sitemap.xml",
"https://stripe.com/sitemap/partition-0.xml"
],
"robots_txt_found": true,
"sitemap_url_count": 0
}
}
},
"schema": {
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"input"
],
"properties": {
"input": {
"type": "object",
"required": [
"type",
"method"
],
"properties": {
"type": {
"type": "string",
"const": "http"
},
"method": {
"enum": [
"GET",
"HEAD",
"DELETE"
],
"type": "string"
},
"queryParams": {
"type": "object",
"required": [
"domain"
],
"properties": {
"limit": {
"type": "integer",
"description": "Sitemap URLs to return (1-1000)"
},
"domain": {
"type": "string",
"description": "Domain name"
}
}
}
},
"additionalProperties": false
},
"output": {
"type": "object",
"required": [
"type"
],
"properties": {
"type": {
"type": "string"
},
"example": {
"type": "object"
}
}
}
}
}
}
}Provenance
- Seen in the source catalog
- 2026-10-23 13:46Z
- Last indexed by Roundhouse
- 2026-10-26 17:30Z
- Last enriched (probe, favicon, geo)
- 2026-10-22 11:16Z
- x402 version
- 2
- Max timeout
- 300s
- Liveness probe
- HTTP 402
Hand this page to an agent
Copy the prompt and paste it into Claude, an MCP client or your own agent — it will vet this service and call it over the free read API. No key, no account.
GET api.roundhouseai.io/v0/endpoints
This endpoint's own trailing-30-day call count, as published by the upstream catalog and snapshotted daily. 4 snapshots so far. Verified volume counts only settlements with an on-chain EIP-3009 marker.
Show the promptHide the prompt
Using Roundhouse, look up the x402 service Robots.txt & Sitemap and tell me whether it is worth paying: what a call costs, whether the endpoint answered when last probed, and what its payment record actually shows. curl -s 'https://api.roundhouseai.io/v0/endpoints?q=Robots.txt%20%26%20Sitemap' curl -s 'https://api.roundhouseai.io/v0/merchants/<the payTo wallet returned above>' Then call it: read the price from the live 402 at https://bess-x402.onrender.com/v1/web/robots, never from a cached figure, and pay with an x402 client. The /v0 API needs an API key (`authorization: Bearer rh_live_…`) on everything except /v0/unified* and /v0/endpoints. Either pay over x402 (mint a personal key for $0.01 at GET https://api.roundhouseai.io/v0/test/x402), or ask me for an organization key, which I create at https://roundhouseai.io/dashboard/connections. If you have neither, ask before going further. If you do not have Roundhouse tools or skills installed, read https://roundhouseai.io/skill.md first — it is the whole procedure.