api.strale.io

Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.

SearchLiveeip155:8453Exactvia cdp
Calls · 30d
3↑ 143%
This endpoint's own trailing-30-day call count, as published by the upstream catalog and snapshotted daily. 30 snapshots so far.
$359.43
Verified settled volume
A floor: summed over 5,000 of 9,020 verified settlements.
$0.022
Listed price
As published in the catalog. Always read the live 402 before paying.
3
Calls · 30d
Upstream's own call count for this endpoint, not ours.
1
Unique payers · 30d
Last called 2026-09-19 06:39Z
Upstream on-chain volume
Reported by the source catalog.
Paid to
0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC

The wallet the 402 directs payment to. Its whole payment record — every payer, every chain — is on the merchant page.

Asset 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913

Provider

The payTo wallet does not resolve to a registered ERC-8004 agent. That is not a verdict on the service — most of the catalog is unregistered.

Live 402 challenge

Captured by the enrichment pass, not read just now. Prices can change — always read the 402 the endpoint answers with.

{
  "error": "Payment required. Robots.txt Parse costs $0.0216 USDC per call.",
  "accepts": [
    {
      "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
      "extra": {
        "name": "USD Coin",
        "version": "2"
      },
      "payTo": "0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC",
      "scheme": "exact",
      "network": "base",
      "mimeType": "application/json",
      "resource": "https://api.strale.io/x402/robots-txt-parse",
      "description": "Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.",
      "outputSchema": {
        "input": {
          "type": "http",
          "method": "GET",
          "queryParams": {
            "url": {
              "type": "string",
              "required": true
            }
          },
          "discoverable": true
        },
        "output": {
          "rules": {
            "type": "array"
          },
          "exists": {
            "type": "boolean"
          },
          "sitemaps": {
            "type": "array"
          },
          "user_agents": {
            "type": "array"
          },
          "blocks_all_crawlers": {
            "type": "boolean"
          }
        }
      },
      "maxAmountRequired": "21600",
      "maxTimeoutSeconds": 300
    }
  ],
  "resource": {
    "url": "https://api.strale.io/x402/robots-txt-parse",
    "mimeType": "application/json",
    "description": "Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked."
  },
  "extensions": {
    "bazaar": {
      "info": {
        "input": {
          "type": "http",
          "method": "GET",
          "queryParams": {
            "url": "example_url"
          }
        }
      },
      "schema": {
        "type": "object",
        "$schema": "https://json-schema.org/draft/2020-12/schema",
        "required": [
          "input"
        ],
        "properties": {
          "input": {
            "type": "object",
            "required": [
              "type",
              "method"
            ],
            "properties": {
              "type": {
                "type": "string",
                "const": "http"
              },
              "method": {
                "enum": [
                  "GET",
                  "HEAD",
                  "DELETE"
                ],
                "type": "string"
              },
              "queryParams": {
                "type": "object",
                "required": [
                  "url"
                ],
                "properties": {
                  "url": {
                    "type": "string"
                  }
                }
              }
            },
            "additionalProperties": false
          }
        }
      }
    }
  },
  "x402Version": 1,
  "paymentRequirements": [
    {
      "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
      "extra": {
        "name": "USD Coin",
        "version": "2"
      },
      "payTo": "0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC",
      "scheme": "exact",
      "network": "base",
      "mimeType": "application/json",
      "resource": "https://api.strale.io/x402/robots-txt-parse",
      "description": "Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.",
      "outputSchema": {
        "input": {
          "type": "http",
          "method": "GET",
          "queryParams": {
            "url": {
              "type": "string",
              "required": true
            }
          },
          "discoverable": true
        },
        "output": {
          "rules": {
            "type": "array"
          },
          "exists": {
            "type": "boolean"
          },
          "sitemaps": {
            "type": "array"
          },
          "user_agents": {
            "type": "array"
          },
          "blocks_all_crawlers": {
            "type": "boolean"
          }
        }
      },
      "maxAmountRequired": "21600",
      "maxTimeoutSeconds": 300
    }
  ]
}

Accepts

The payment requirements as published to the catalog. Read the live 402 before paying — a price here is a claim, not a quote.

0.0216USDC≈ $0.0216 USD
on Base · exact scheme

Pay 0.0216 USDC on Base to 0x66D7…a83bC. The signed payment is good for 5 minutes.

USD Coin contract
0x8335…02913
Payment window
5 minutes
As published
21600 smallest units
Buys
Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.
Returns
application/json
The catalog’s raw entry
[
  {
    "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "extra": {
      "name": "USD Coin",
      "version": "2"
    },
    "payTo": "0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC",
    "scheme": "exact",
    "network": "base",
    "mimeType": "application/json",
    "resource": "https://api.strale.io/x402/robots-txt-parse",
    "description": "Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.",
    "outputSchema": {
      "input": {
        "type": "http",
        "method": "GET",
        "queryParams": {
          "url": {
            "type": "string",
            "required": true
          }
        },
        "discoverable": true
      },
      "output": {
        "rules": {
          "type": "array"
        },
        "exists": {
          "type": "boolean"
        },
        "sitemaps": {
          "type": "array"
        },
        "user_agents": {
          "type": "array"
        },
        "blocks_all_crawlers": {
          "type": "boolean"
        }
      }
    },
    "maxAmountRequired": "21600",
    "maxTimeoutSeconds": 300
  }
]

Extensions

{
  "bazaar": {
    "info": {
      "input": {
        "type": "http",
        "method": "GET",
        "queryParams": {
          "url": {
            "type": "string",
            "required": true
          }
        }
      },
      "output": {}
    },
    "schema": {
      "type": "object",
      "$schema": "https://json-schema.org/draft/2020-12/schema",
      "required": [
        "input"
      ],
      "properties": {
        "input": {
          "type": "object",
          "required": [
            "type",
            "method"
          ],
          "properties": {
            "type": {
              "type": "string",
              "const": "http"
            },
            "method": {
              "enum": [
                "GET"
              ],
              "type": "string"
            },
            "queryParams": {
              "type": "object"
            }
          }
        },
        "output": {
          "type": "object",
          "required": [
            "type"
          ],
          "properties": {
            "type": {
              "type": "string"
            }
          }
        }
      }
    }
  }
}

Provenance

Seen in the source catalog
2026-09-19 06:39Z
Last indexed by Roundhouse
2026-09-24 09:40Z
Last enriched (probe, favicon, geo)
2026-09-23 22:45Z
x402 version
1
Max timeout
300s
Liveness probe
HTTP 402
Report

Hand this page to an agent

Copy the prompt and paste it into Claude, an MCP client or your own agent — it will vet this service and call it over the free read API. No key, no account.

GET api.roundhouseai.io/v0/endpoints

This endpoint's own trailing-30-day call count, as published by the upstream catalog and snapshotted daily. 30 snapshots so far. Verified volume counts only settlements with an on-chain EIP-3009 marker.

Open skill.md
Show the prompt
Using Roundhouse, look up the x402 service api.strale.io and tell me whether it is
worth paying: what a call costs, whether the endpoint answered when last probed, and what
its payment record actually shows.

curl -s 'https://api.roundhouseai.io/v0/endpoints?q=api.strale.io'
curl -s 'https://api.roundhouseai.io/v0/merchants/<the payTo wallet returned above>'

Then call it: read the price from the live 402 at https://api.strale.io/x402/robots-txt-parse, never from
a cached figure, and pay with an x402 client.

The /v0 API needs an API key (`authorization: Bearer rh_live_…`) on everything except
/v0/unified* and /v0/endpoints. Mint a personal key for $0.01 at GET https://api.roundhouseai.io/v0/test/x402,
or use an organization key from https://roundhouseai.io/dashboard/team.

If you do not have Roundhouse tools or skills installed, read
https://roundhouseai.io/skill.md first — it is the whole procedure.