Delx Robots Inspect
Read robots.txt rules and sitemap declarations before crawling or indexing a domain.
The wallet the 402 directs payment to. Its whole payment record — every payer, every chain — is on the merchant page.
Asset 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913
Live 402 challenge
Captured by the enrichment pass, not read just now. Prices can change — always read the 402 the endpoint answers with.
{
"error": "Payment required: $0.01 USDC for util_robots_inspect",
"accepts": [
{
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"extra": {
"app": "Delx Commerce",
"name": "USD Coin",
"version": "2",
"provider": "coinbase",
"erc8004_id": "14340",
"accept_label": "Coinbase CDP",
"provider_label": "Coinbase CDP",
"facilitator_url": "https://api.cdp.coinbase.com/platform/v2/x402"
},
"payTo": "0x9f8bd9875b3E0b632a24A3A7C73f7787175e73A2",
"amount": "10000",
"scheme": "exact",
"network": "eip155:8453",
"mimeType": "application/json",
"resource": "https://api.delx.ai/api/v1/x402/robots-inspect",
"description": "Robots.txt inspection API for agents at $0.01 USDC. Call when you need crawl rules and sitemap hints before indexing or scraping a domain. Use for SEO preflight and polite crawlers via x402—no API key, no subscription.",
"inputSchema": {
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string"
},
"timeout": {
"type": "integer",
"maximum": 15,
"minimum": 1
}
},
"additionalProperties": false
},
"outputSchema": {
"type": "object",
"required": [
"tool_name",
"result"
],
"properties": {
"result": {
"type": "object",
"required": [
"robots_url",
"allow",
"disallow",
"sitemaps"
],
"properties": {
"allow": {
"type": "array",
"items": {
"type": "string"
}
},
"disallow": {
"type": "array",
"items": {
"type": "string"
}
},
"sitemaps": {
"type": "array",
"items": {
"type": "string"
}
},
"robots_url": {
"type": "string"
}
},
"additionalProperties": true
},
"tool_name": {
"type": "string",
"const": "util_robots_inspect"
}
},
"additionalProperties": false
},
"maxTimeoutSeconds": 300
},
{
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"extra": {
"app": "Delx Commerce",
"name": "USD Coin",
"version": "2",
"provider": "payai",
"erc8004_id": "14340",
"accept_label": "PayAI Base",
"provider_label": "PayAI Base",
"facilitator_url": "https://facilitator.payai.network"
},
"payTo": "0x9f8bd9875b3E0b632a24A3A7C73f7787175e73A2",
"amount": "10000",
"scheme": "exact",
"network": "eip155:8453",
"mimeType": "application/json",
"resource": "https://api.delx.ai/api/v1/x402/robots-inspect",
"description": "Robots.txt inspection API for agents at $0.01 USDC. Call when you need crawl rules and sitemap hints before indexing or scraping a domain. Use for SEO preflight and polite crawlers via x402—no API key, no subscription.",
"inputSchema": {
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string"
},
"timeout": {
"type": "integer",
"maximum": 15,
"minimum": 1
}
},
"additionalProperties": false
},
"outputSchema": {
"type": "object",
"required": [
"tool_name",
"result"
],
"properties": {
"result": {
"type": "object",
"required": [
"robots_url",
"allow",
"disallow",
"sitemaps"
],
"properties": {
"allow": {
"type": "array",
"items": {
"type": "string"
}
},
"disallow": {
"type": "array",
"items": {
"type": "string"
}
},
"sitemaps": {
"type": "array",
"items": {
"type": "string"
}
},
"robots_url": {
"type": "string"
}
},
"additionalProperties": true
},
"tool_name": {
"type": "string",
"const": "util_robots_inspect"
}
},
"additionalProperties": false
},
"maxTimeoutSeconds": 300
},
{
"asset": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v",
"extra": {
"app": "Delx Commerce",
"name": "USD Coin",
"version": "2",
"feePayer": "CjNFTjvBhbJJd2B5ePPMHRLx1ELZpa8dwQgGL727eKww",
"provider": "payai",
"erc8004_id": "14340",
"accept_label": "PayAI Solana",
"provider_label": "PayAI Solana",
"facilitator_url": "https://facilitator.payai.network"
},
"payTo": "28heAMpFkeUJsL7o7apiK4oJwZWq2fUHinRwbgYYsemG",
"amount": "10000",
"scheme": "exact",
"network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
"mimeType": "application/json",
"resource": "https://api.delx.ai/api/v1/x402/robots-inspect",
"description": "Robots.txt inspection API for agents at $0.01 USDC. Call when you need crawl rules and sitemap hints before indexing or scraping a domain. Use for SEO preflight and polite crawlers via x402—no API key, no subscription.",
"inputSchema": {
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string"
},
"timeout": {
"type": "integer",
"maximum": 15,
"minimum": 1
}
},
"additionalProperties": false
},
"outputSchema": {
"type": "object",
"required": [
"tool_name",
"result"
],
"properties": {
"result": {
"type": "object",
"required": [
"robots_url",
"allow",
"disallow",
"sitemaps"
],
"properties": {
"allow": {
"type": "array",
"items": {
"type": "string"
}
},
"disallow": {
"type": "array",
"items": {
"type": "string"
}
},
"sitemaps": {
"type": "array",
"items": {
"type": "string"
}
},
"robots_url": {
"type": "string"
}
},
"additionalProperties": true
},
"tool_name": {
"type": "string",
"const": "util_robots_inspect"
}
},
"additionalProperties": false
},
"maxTimeoutSeconds": 300
}
],
"resource": {
"url": "https://api.delx.ai/api/v1/x402/robots-inspect",
"tags": [
"x402",
"utility",
"robots",
"seo",
"web"
],
"iconUrl": "https://delx.ai/opengraph-image?v=20260305-fox",
"mimeType": "application/json",
"description": "Robots.txt inspection API for agents at $0.01 USDC. Call when you need crawl rules and sitemap hints before indexing or scraping a domain. Use for SEO preflight and polite crawlers via x402—no API key, no subscription.",
"serviceName": "Delx Robots Inspect"
},
"extensions": {
"delx": {
"docs": {
"pricing": "https://delx.ai/docs/pricing",
"mpp_setup": "https://delx.ai/docs/mpp-setup",
"ows_setup": "https://delx.ai/docs/ows-setup",
"x402_setup": "https://delx.ai/docs/x402-setup",
"tools_catalog": "https://api.delx.ai/api/v1/tools",
"monetization_policy": "https://api.delx.ai/api/v1/monetization-policy",
"x402_capability_probe": "https://api.delx.ai/api/v1/x402-capability?agent_id=<AGENT_ID>"
},
"orbit": {
"use": "Spend vested OC now: 100 OC = 0.001 USDC; cover up to 20% of an eligible call.",
"docs": "https://commerce.delx.ai/orbit.md",
"note": "Earn OC on verified paid calls. Utility rebate, not yield.",
"spec": "https://commerce.delx.ai/orbit.json",
"claim": "POST /api/v1/rewards/wallet-nonce then /api/v1/rewards/bind-wallet",
"redeem": "POST /api/v1/orbit/vouchers",
"status": "https://api.delx.ai/api/v1/orbit/status",
"program": "delx-orbit-season-0",
"cashback": "eligible"
},
"method": "POST",
"docs_url": "https://delx.ai/docs/x402-setup",
"agentcash": {
"fetch": "npx agentcash@latest fetch <paid-resource-url> -m POST -H 'content-type: application/json' -b '<same-json-body>' --payment-protocol x402 --max-amount <published-price> -y",
"balance": "npx agentcash@latest balance",
"onboard": "https://agentcash.dev/onboard?r=REF-3KE2-22D3-XJBM-SGAR",
"accounts": "npx agentcash@latest accounts",
"discover": "npx agentcash@latest discover https://api.delx.ai",
"bonus_note": "If eligible, start from the Delx AgentCash onboarding link before funding the wallet.",
"solana_note": "PayAI is the advertised fee payer for Delx Solana accepts, so the buyer needs USDC on Solana but does not need SOL for the network fee.",
"fetch_by_network": {
"base": "npx agentcash@latest fetch <paid-resource-url> -m POST -H 'content-type: application/json' -b '<same-json-body>' --payment-protocol x402 --payment-network base --max-amount <published-price> -y",
"solana": "npx agentcash@latest fetch <paid-resource-url> -m POST -H 'content-type: application/json' -b '<same-json-body>' --payment-protocol x402 --payment-network solana --max-amount <published-price> -y"
}
},
"tool_name": "util_robots_inspect",
"next_steps": [
"Read accepts[] and choose the payment provider that matches your controller policy.",
"Create/sign payment proof for the selected accepts[] amount and retry the same request with PAYMENT-SIGNATURE.",
"If your REST client speaks MPP, reuse the same request body and retry with Authorization: Payment <credential> after the WWW-Authenticate challenge.",
"If you choose a non-default provider, send x-payment-provider on the retry to pin routing explicitly.",
"When the same provider appears on multiple networks, choose the exact accepts[] entry by network + asset before signing.",
"Keep reading prices from /api/v1/tools (do not hardcode).",
"If you need an AgentCash wallet first, open agentcash.onboard and complete onboarding before retrying the paid call.",
"If your agent does not support x402 yet, use AgentCash for the paid retry or route to free_alternatives[] and stay on Delx's free path."
],
"reason_code": "payment_required",
"sample_input": {
"url": "https://example.com"
},
"sample_output": {
"result": {
"allow": [],
"disallow": [],
"sitemaps": [],
"robots_url": "https://example.com/robots.txt"
},
"tool_name": "util_robots_inspect"
},
"free_alternative": {
"tool": "quick_operational_recovery",
"price_usdc": "0",
"schema_url": "https://api.delx.ai/api/v1/tools/schema/quick_operational_recovery",
"description": "Free one-call recovery bootstrap.",
"x402_required": false
},
"header_shortcuts": {},
"runtime_examples": {
"a2a_retry": "curl -X POST https://api.delx.ai/v1/a2a -H 'Content-Type: application/json' -H 'PAYMENT-SIGNATURE: <SIGNED_PAYMENT>' -d '<same-jsonrpc-payload>'",
"mcp_retry": "curl -X POST https://api.delx.ai/v1/mcp -H 'Content-Type: application/json' -H 'PAYMENT-SIGNATURE: <SIGNED_PAYMENT>' -d '<same-jsonrpc-payload>'",
"rest_retry": "curl -X POST <paid-resource-url> -H 'Content-Type: application/json' -H 'PAYMENT-SIGNATURE: <SIGNED_PAYMENT>' -d '<same-json-body>'",
"rest_retry_mpp": "curl -X POST <paid-resource-url> -H 'Content-Type: application/json' -H 'Authorization: Payment <MPP_CREDENTIAL>' -d '<same-json-body>'"
},
"validation_error": {
"docs": {
"pricing": "https://delx.ai/docs/pricing",
"x402_setup": "https://delx.ai/docs/x402-setup"
},
"hint": "Pass the required premium tool input before retrying.",
"error": "missing required parameter(s): url",
"examples": {},
"required": [
"url"
],
"tool_name": "util_robots_inspect",
"accepted_inputs": {
"agent_id": {
"body": [
"agent_id",
"agentId"
],
"query": [
"agent_id",
"agentId"
],
"headers": [
"x-delx-agent-id",
"x-agent-id",
"x-openclaw-agent-id"
]
}
}
},
"free_alternatives": [
{
"tool": "quick_operational_recovery",
"price_usdc": "0",
"schema_url": "https://api.delx.ai/api/v1/tools/schema/quick_operational_recovery",
"description": "Free one-call recovery bootstrap.",
"x402_required": false
},
{
"tool": "process_failure",
"price_usdc": "0",
"schema_url": "https://api.delx.ai/api/v1/tools/schema/process_failure",
"description": "Free failure analysis and typed recovery direction.",
"x402_required": false
},
{
"tool": "monitor_heartbeat_sync",
"price_usdc": "0",
"schema_url": "https://api.delx.ai/api/v1/tools/schema/monitor_heartbeat_sync",
"description": "Free heartbeat sync for current health and reliability state.",
"x402_required": false
}
],
"primary_followups": []
},
"bazaar": {
"info": {
"input": {
"body": {
"url": "https://example.com"
},
"type": "http",
"method": "POST",
"bodyType": "json"
},
"output": {
"type": "json",
"example": {
"result": {
"allow": [],
"disallow": [],
"sitemaps": [],
"robots_url": "https://example.com/robots.txt"
},
"tool_name": "util_robots_inspect"
}
}
},
"tags": [
"x402",
"utility",
"robots",
"seo",
"web"
],
"schema": {
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"input",
"output"
],
"properties": {
"input": {
"type": "object",
"required": [
"type",
"bodyType",
"body"
],
"properties": {
"body": {
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string"
},
"timeout": {
"type": "integer",
"maximum": 15,
"minimum": 1
}
},
"additionalProperties": false
},
"type": {
"type": "string",
"const": "http"
},
"method": {
"enum": [
"POST",
"PUT",
"PATCH"
],
"type": "string"
},
"bodyType": {
"enum": [
"json",
"form-data",
"text"
],
"type": "string"
}
},
"additionalProperties": false
},
"output": {
"type": "object",
"required": [
"type",
"example"
],
"properties": {
"type": {
"type": "string",
"const": "json"
},
"example": {
"result": {
"allow": [],
"disallow": [],
"sitemaps": [],
"robots_url": "https://example.com/robots.txt"
},
"tool_name": "util_robots_inspect"
}
}
}
}
},
"iconUrl": "https://delx.ai/opengraph-image?v=20260305-fox",
"summary": "Robots.txt inspection API for agents at $0.01 USDC. Call when you need crawl rules and sitemap hints before indexing or scraping a domain. Use for SEO preflight and polite crawlers via x402—no API key, no subscription.",
"category": "utility",
"featured": false,
"provider": "coinbase",
"tool_name": "util_robots_inspect",
"coverImage": "https://delx.ai/opengraph-image?v=20260305-fox",
"suspension": null,
"serviceName": "Delx Robots Inspect",
"discoverable": true,
"listing_status": "payment_verified_waiting_for_index",
"indexed_publicly": false,
"listing_blockers": []
},
"payment-identifier": {
"info": {
"required": false
},
"schema": {
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"required"
],
"properties": {
"id": {
"type": "string",
"pattern": "^[a-zA-Z0-9_-]+$",
"maxLength": 128,
"minLength": 16
},
"required": {
"type": "boolean"
}
}
}
}
},
"reason_code": "payment_required",
"x402Version": 2
}Accepts
The payment requirements as published to the catalog. Read the live 402 before paying — a price here is a claim, not a quote.
Pay 0.01 USDC on Base to 0x9f8b…e73A2. The signed payment is good for 5 minutes.
- Paid to
- 0x9f8b…e73A2
- USD Coin contract
- 0x8335…02913
- Payment window
- 5 minutes
- As published
- 10000 smallest units
- Buys
- Read robots.txt rules and sitemap declarations before crawling or indexing a domain.
- Returns
- application/json
Pay 0.01 USDC on Base to 0x9f8b…e73A2. The signed payment is good for 5 minutes.
- Paid to
- 0x9f8b…e73A2
- USD Coin contract
- 0x8335…02913
- Payment window
- 5 minutes
- As published
- 10000 smallest units
- Buys
- Read robots.txt rules and sitemap declarations before crawling or indexing a domain.
- Returns
- application/json
That figure is in the token’s smallest units. Roundhouse does not hold this contract’s decimals, so it is shown as published rather than converted.
- Paid to
- 28heAM…YsemG
- Token contract
- EPjFWd…TDt1v
- Payment window
- 5 minutes
- Buys
- Read robots.txt rules and sitemap declarations before crawling or indexing a domain.
- Returns
- application/json
The catalog’s raw entry
[
{
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"extra": {
"app": "Delx Agent Operations Protocol",
"name": "USD Coin",
"version": "2",
"provider": "coinbase",
"accept_label": "Coinbase CDP",
"provider_label": "Coinbase CDP",
"facilitator_url": "https://api.cdp.coinbase.com/platform/v2/x402"
},
"payTo": "0x9f8bd9875b3E0b632a24A3A7C73f7787175e73A2",
"amount": "10000",
"scheme": "exact",
"network": "eip155:8453",
"mimeType": "application/json",
"resource": "https://api.delx.ai/api/v1/x402/robots-inspect",
"description": "Read robots.txt rules and sitemap declarations before crawling or indexing a domain.",
"maxTimeoutSeconds": 300
},
{
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"extra": {
"app": "Delx Agent Operations Protocol",
"name": "USD Coin",
"version": "2",
"provider": "payai",
"accept_label": "PayAI Base",
"provider_label": "PayAI Base",
"facilitator_url": "https://facilitator.payai.network"
},
"payTo": "0x9f8bd9875b3E0b632a24A3A7C73f7787175e73A2",
"amount": "10000",
"scheme": "exact",
"network": "eip155:8453",
"mimeType": "application/json",
"resource": "https://api.delx.ai/api/v1/x402/robots-inspect",
"description": "Read robots.txt rules and sitemap declarations before crawling or indexing a domain.",
"maxTimeoutSeconds": 300
},
{
"asset": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v",
"extra": {
"app": "Delx Agent Operations Protocol",
"name": "USD Coin",
"version": "2",
"feePayer": "2wKupLR9q6wXYppw8Gr2NvWxKBUqm4PPJKkQfoxHDBg4",
"provider": "payai",
"accept_label": "PayAI Solana",
"provider_label": "PayAI Solana",
"facilitator_url": "https://facilitator.payai.network"
},
"payTo": "28heAMpFkeUJsL7o7apiK4oJwZWq2fUHinRwbgYYsemG",
"amount": "10000",
"scheme": "exact",
"network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
"mimeType": "application/json",
"resource": "https://api.delx.ai/api/v1/x402/robots-inspect",
"description": "Read robots.txt rules and sitemap declarations before crawling or indexing a domain.",
"maxTimeoutSeconds": 300
}
]Extensions
{
"bazaar": {
"info": {
"input": {
"body": {
"url": "https://example.com"
},
"type": "http",
"method": "POST",
"bodyType": "json"
},
"output": {
"type": "json",
"example": {
"result": {
"allow": [],
"disallow": [],
"sitemaps": [],
"robots_url": "https://example.com/robots.txt"
},
"tool_name": "util_robots_inspect"
}
}
},
"tags": [
"x402",
"utility",
"robots",
"seo",
"web"
],
"schema": {
"type": "object",
"$schema": "https://json-schema.org/draft/2020-12/schema",
"required": [
"input"
],
"properties": {
"input": {
"type": "object",
"required": [
"type",
"bodyType",
"body"
],
"properties": {
"body": {
"type": "object",
"required": [
"url"
],
"properties": {
"url": {
"type": "string"
},
"timeout": {
"type": "integer",
"maximum": 15,
"minimum": 1
}
},
"additionalProperties": false
},
"type": {
"type": "string",
"const": "http"
},
"method": {
"enum": [
"POST",
"PUT",
"PATCH"
],
"type": "string"
},
"bodyType": {
"enum": [
"json",
"form-data",
"text"
],
"type": "string"
}
},
"additionalProperties": false
},
"output": {
"type": "object",
"required": [
"type"
],
"properties": {
"type": {
"type": "string"
},
"example": {
"type": "object",
"required": [
"tool_name",
"result"
],
"properties": {
"result": {
"type": "object",
"required": [
"robots_url",
"allow",
"disallow",
"sitemaps"
],
"properties": {
"allow": {
"type": "array",
"items": {
"type": "string"
}
},
"disallow": {
"type": "array",
"items": {
"type": "string"
}
},
"sitemaps": {
"type": "array",
"items": {
"type": "string"
}
},
"robots_url": {
"type": "string"
}
},
"additionalProperties": true
},
"tool_name": {
"type": "string",
"const": "util_robots_inspect"
}
},
"additionalProperties": false
}
}
}
}
},
"summary": "Read robots.txt rules and sitemap declarations before crawling or indexing a domain.",
"category": "utility",
"coverImage": "https://delx.ai/opengraph-image?v=20260305-fox",
"serviceName": "Delx Robots Inspect"
}
}Provenance
- Seen in the source catalog
- 2026-08-04 22:39Z
- Last indexed by Roundhouse
- 2026-09-03 17:30Z
- Last enriched (probe, favicon, geo)
- 2026-09-13 23:15Z
- x402 version
- 2
- Max timeout
- 300s
- Liveness probe
- HTTP 402
Hand this page to an agent
Copy the prompt and paste it into Claude, an MCP client or your own agent — it will vet this service and call it over the free read API. No key, no account.
GET api.roundhouseai.io/v0/endpoints
This endpoint's own trailing-30-day call count, as published by the upstream catalog and snapshotted daily. 21 snapshots so far. Verified volume counts only settlements with an on-chain EIP-3009 marker.
Show the promptHide the prompt
Using Roundhouse, look up the x402 service Delx Robots Inspect and tell me whether it is worth paying: what a call costs, whether the endpoint answered when last probed, and what its payment record actually shows. curl -s 'https://api.roundhouseai.io/v0/endpoints?q=Delx%20Robots%20Inspect' curl -s 'https://api.roundhouseai.io/v0/merchants/<the payTo wallet returned above>' Then call it: read the price from the live 402 at https://api.delx.ai/api/v1/x402/robots-inspect, never from a cached figure, and pay with an x402 client. The /v0 API needs an API key (`authorization: Bearer rh_live_…`) on everything except /v0/unified* and /v0/endpoints. Mint a personal key for $0.01 at GET https://api.roundhouseai.io/v0/test/x402, or use an organization key from https://roundhouseai.io/dashboard/team. If you do not have Roundhouse tools or skills installed, read https://roundhouseai.io/skill.md first — it is the whole procedure.