Website Crawler to Markdown

Name: Website Crawler to Markdown
Price: 0.005 USDC
Availability: InStock

Website crawler: read a whole website or one section of it (for example every page under /docs) as clean Markdown: starts at a URL, follows same-site links breadth-first and returns up to 20 pages with title and description. Use for documentation, product catalogs or company sites. For one page use web-scrape, for a known list of URLs web-read-batch (up to 5) or web-scrape-batch (up to 20). Charged only if at least one page was read.

SearchLiveeip155:8453Exactvia cdp

https://agentsvc.io/api/v1/proxy/site-crawl

Web-crawlerSite-crawlWebsite-to-markdownCrawlMarkdown

Calls · 30d

12↑ 3.9%

This endpoint's own trailing-30-day call count, as published by the upstream catalog and snapshotted daily. 24 snapshots so far.

$8.64

Verified settled volume

1,228 settlements proven x402 by their on-chain EIP-3009 marker.

$0.0050

Listed price

As published in the catalog. Always read the live 402 before paying.

Calls · 30d

Upstream's own call count for this endpoint, not ours.

Unique payers · 30d

Last called 2026-10-22 11:19Z

—

Upstream on-chain volume

Reported by the source catalog.

Paid to

0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27

The wallet the 402 directs payment to. Its whole payment record — every payer, every chain — is on the merchant page.

Asset 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913

Provider

agentsvc.ioERC-8004

Live 402 challenge

Captured by the enrichment pass, not read just now. Prices can change — always read the 402 the endpoint answers with.

{
  "docs": "https://agentsvc.io/docs",
  "hint": "This call costs $0.015 USDC, paid per request with USDC on Base or Solana mainnet via x402. No account, no API key. Easiest: use an x402 client (JavaScript: @x402/fetch + @x402/evm, Python: pip install x402) with a wallet holding USDC on Base; it handles the 402 automatically. Manual: sign an EIP-3009 TransferWithAuthorization for the requirements in accepts[0] (v1) or in the PAYMENT-REQUIRED response header (v2) and retry with the X-PAYMENT (v1) or PAYMENT-SIGNATURE (v2) header.",
  "error": "payment_required",
  "accepts": [
    {
      "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
      "extra": {
        "name": "USD Coin",
        "version": "2"
      },
      "payTo": "0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27",
      "scheme": "exact",
      "network": "base",
      "mimeType": "application/json",
      "resource": "https://agentsvc.io/api/v1/proxy/site-crawl",
      "description": "Crawl a website from a start URL and return up to 20 same-site HTML pages as clean Markdown with title and description (breadth-first, 3 in parallel, skips files and non-HTML). Optional path_prefix keeps the crawl inside a section such as /docs. Charged only if at least one page was read. Params: url (required), max_pages (1 to 20, default 5), max_chars per page (500 to 20000, default 4000), path_prefix.",
      "outputSchema": {
        "input": {
          "body": {
            "url": "https://agentsvc.io/docs",
            "max_chars": 2000,
            "max_pages": 3
          },
          "type": "http",
          "method": "POST",
          "bodyType": "json",
          "discoverable": true
        },
        "output": {
          "site": "https://agentsvc.io",
          "pages": [
            {
              "ok": true,
              "url": "https://agentsvc.io/docs",
              "title": "Docs: how agents pay per call with x402 · agentsvc.io",
              "status": 200,
              "markdown": "Documentation\n\n# Pay per call. Nothing else to set up.\n\nEvery service is a JSON endpoint behind HTTP 402. If you already use an x402 client, you are done: po…",
              "word_count": 104,
              "description": "Quickstart, payment protocol (x402 v1 and v2), free trial, error codes and the reference for every service on agentsvc.io."
            },
            {
              "ok": true,
              "url": "https://agentsvc.io/services/erc20-info",
              "title": "ERC20 Token Info: $0.002 USDC per call · agentsvc.io",
              "status": 200,
              "markdown": "[services](/services) / erc20-info\n\ndataoperational · 240 ms\n\n# ERC20 Token Info\n\nRead an ERC20 token contract on Base or Ethereum mainnet: name, symbol, dec…",
              "word_count": 83,
              "description": "Read an ERC20 token contract on Base or Ethereum mainnet: name, symbol, decimals, total supply, and optionally the balance of one holder address. Verifies that "
            }
          ],
          "took_ms": 125,
          "ok_count": 2,
          "crawled_at": "2026-10-06T14:17:50.682Z",
          "pages_crawled": 2,
          "discovered_urls": 37,
          "skipped_non_html": 2
        }
      },
      "maxAmountRequired": "15000",
      "maxTimeoutSeconds": 300
    },
    {
      "asset": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v",
      "extra": {
        "feePayer": "Hc3sdEAsCGQcpgfivywog9uwtk8gUBUZgsxdME1EJy88"
      },
      "payTo": "5JzPS5qpEwUM1vTC9GG7uqvwJdHzbEwfoPHf2Ki977tg",
      "scheme": "exact",
      "network": "solana",
      "mimeType": "application/json",
      "resource": "https://agentsvc.io/api/v1/proxy/site-crawl",
      "description": "Crawl a website from a start URL and return up to 20 same-site HTML pages as clean Markdown with title and description (breadth-first, 3 in parallel, skips files and non-HTML). Optional path_prefix keeps the crawl inside a section such as /docs. Charged only if at least one page was read. Params: url (required), max_pages (1 to 20, default 5), max_chars per page (500 to 20000, default 4000), path_prefix.",
      "outputSchema": {
        "input": {
          "body": {
            "url": "https://agentsvc.io/docs",
            "max_chars": 2000,
            "max_pages": 3
          },
          "type": "http",
          "method": "POST",
          "bodyType": "json",
          "discoverable": true
        },
        "output": {
          "site": "https://agentsvc.io",
          "pages": [
            {
              "ok": true,
              "url": "https://agentsvc.io/docs",
              "title": "Docs: how agents pay per call with x402 · agentsvc.io",
              "status": 200,
              "markdown": "Documentation\n\n# Pay per call. Nothing else to set up.\n\nEvery service is a JSON endpoint behind HTTP 402. If you already use an x402 client, you are done: po…",
              "word_count": 104,
              "description": "Quickstart, payment protocol (x402 v1 and v2), free trial, error codes and the reference for every service on agentsvc.io."
            },
            {
              "ok": true,
              "url": "https://agentsvc.io/services/erc20-info",
              "title": "ERC20 Token Info: $0.002 USDC per call · agentsvc.io",
              "status": 200,
              "markdown": "[services](/services) / erc20-info\n\ndataoperational · 240 ms\n\n# ERC20 Token Info\n\nRead an ERC20 token contract on Base or Ethereum mainnet: name, symbol, dec…",
              "word_count": 83,
              "description": "Read an ERC20 token contract on Base or Ethereum mainnet: name, symbol, decimals, total supply, and optionally the balance of one holder address. Verifies that "
            }
          ],
          "took_ms": 125,
          "ok_count": 2,
          "crawled_at": "2026-10-06T14:17:50.682Z",
          "pages_crawled": 2,
          "discovered_urls": 37,
          "skipped_non_html": 2
        }
      },
      "maxAmountRequired": "15000",
      "maxTimeoutSeconds": 300
    }
  ],
  "payment": {
    "asset": "USDC",
    "pay_to": "0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27",
    "scheme": "exact",
    "network": "eip155:8453",
    "chain_id": 8453,
    "price_usd": 0.015,
    "network_v1": "base",
    "also_accepted": {
      "see": "accepts[1] (v1 body) or PAYMENT-REQUIRED accepts[1] (v2)",
      "pay_to": "5JzPS5qpEwUM1vTC9GG7uqvwJdHzbEwfoPHf2Ki977tg",
      "network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
      "asset_mint": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v"
    },
    "amount_atomic": "15000",
    "asset_contract": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "x402_versions_accepted": [
      1,
      2
    ]
  },
  "try_free": "https://agentsvc.io/api/v1/try/site-crawl",
  "x402Version": 1,
  "service_info": "https://agentsvc.io/api/v1/services/site-crawl"
}

Accepts

The payment requirements as published to the catalog. Read the live 402 before paying — a price here is a claim, not a quote.

0.005USDC≈ $0.005 USD

on Base · exact scheme

Pay 0.005 USDC on Base to 0x622e…74F27. The signed payment is good for 5 minutes.

Paid to: 0x622e…74F27
USD Coin contract: 0x8335…02913
Payment window: 5 minutes
As published: 5000 smallest units

5000units

on solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp · exact scheme

That figure is in the token’s smallest units. Roundhouse does not hold this contract’s decimals, so it is shown as published rather than converted.

Paid to: 5JzPS5…977tg
Token contract: EPjFWd…TDt1v
Payment window: 5 minutes

5000units

on Polygon · exact scheme

That figure is in the token’s smallest units. Roundhouse does not hold this contract’s decimals, so it is shown as published rather than converted.

Paid to: 0x622e…74F27
Token contract: 0x3c49…c3359
Payment window: 5 minutes

5000units

on Arbitrum · exact scheme

That figure is in the token’s smallest units. Roundhouse does not hold this contract’s decimals, so it is shown as published rather than converted.

Paid to: 0x622e…74F27
Token contract: 0xaf88…e5831
Payment window: 5 minutes

The catalog’s raw entry

[
  {
    "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "extra": {
      "name": "USD Coin",
      "version": "2"
    },
    "payTo": "0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27",
    "amount": "5000",
    "scheme": "exact",
    "network": "eip155:8453",
    "maxTimeoutSeconds": 300
  },
  {
    "asset": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v",
    "extra": {
      "feePayer": "Hc3sdEAsCGQcpgfivywog9uwtk8gUBUZgsxdME1EJy88"
    },
    "payTo": "5JzPS5qpEwUM1vTC9GG7uqvwJdHzbEwfoPHf2Ki977tg",
    "amount": "5000",
    "scheme": "exact",
    "network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
    "maxTimeoutSeconds": 300
  },
  {
    "asset": "0x3c499c542cEF5E3811e1192ce70d8cC03d5c3359",
    "extra": {
      "name": "USD Coin",
      "version": "2"
    },
    "payTo": "0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27",
    "amount": "5000",
    "scheme": "exact",
    "network": "eip155:137",
    "maxTimeoutSeconds": 300
  },
  {
    "asset": "0xaf88d065e77c8cC2239327C5EDb3A432268e5831",
    "extra": {
      "name": "USD Coin",
      "version": "2"
    },
    "payTo": "0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27",
    "amount": "5000",
    "scheme": "exact",
    "network": "eip155:42161",
    "maxTimeoutSeconds": 300
  }
]

Extensions

{
  "bazaar": {
    "info": {
      "input": {
        "body": {
          "url": "https://agentsvc.io/docs",
          "max_chars": 2000,
          "max_pages": 3
        },
        "type": "http",
        "method": "POST",
        "bodyType": "json"
      },
      "output": {
        "type": "json",
        "example": {
          "data": {
            "site": "https://agentsvc.io",
            "pages": [
              {
                "ok": true,
                "url": "https://agentsvc.io/docs",
                "title": "Docs: how agents pay per call with x402 · agentsvc.io",
                "status": 200,
                "markdown": "Documentation\n\n# Pay per call. Nothing else to set up.\n\nEvery service is a JS...",
                "word_count": 104,
                "description": "Quickstart, payment protocol (x402 v1 and v2), free trial, error codes and th..."
              }
            ],
            "took_ms": 125,
            "ok_count": 2,
            "crawled_at": "2026-10-06T14:17:50.682Z",
            "pages_crawled": 2,
            "discovered_urls": 37,
            "skipped_non_html": 2
          },
          "success": true
        }
      }
    },
    "tags": [
      "web-crawler",
      "site-crawl",
      "website-to-markdown",
      "crawl",
      "markdown",
      "rag",
      "scrape",
      "web"
    ],
    "schema": {
      "type": "object",
      "$schema": "https://json-schema.org/draft/2020-12/schema",
      "required": [
        "input"
      ],
      "properties": {
        "input": {
          "type": "object",
          "required": [
            "type",
            "method",
            "bodyType",
            "body"
          ],
          "properties": {
            "body": {
              "required": [
                "url"
              ],
              "properties": {
                "url": {
                  "type": "string"
                },
                "max_chars": {
                  "type": "integer",
                  "default": 4000,
                  "maximum": 20000,
                  "minimum": 500
                },
                "max_pages": {
                  "type": "integer",
                  "default": 5,
                  "maximum": 20,
                  "minimum": 1
                },
                "path_prefix": {
                  "type": "string",
                  "description": "Only follow links whose path starts with this, e.g. /docs"
                }
              }
            },
            "type": {
              "type": "string",
              "const": "http"
            },
            "method": {
              "enum": [
                "POST",
                "PUT",
                "PATCH"
              ],
              "type": "string"
            },
            "bodyType": {
              "enum": [
                "json",
                "form-data",
                "text"
              ],
              "type": "string"
            }
          },
          "additionalProperties": false
        },
        "output": {
          "type": "object",
          "required": [
            "type"
          ],
          "properties": {
            "type": {
              "type": "string"
            },
            "example": {
              "type": "object",
              "required": [
                "success",
                "data"
              ],
              "properties": {
                "data": {
                  "type": "object",
                  "required": [
                    "site",
                    "pages_crawled",
                    "ok_count",
                    "pages"
                  ],
                  "properties": {
                    "site": {
                      "type": "string"
                    },
                    "pages": {
                      "type": "array",
                      "items": {
                        "type": "object",
                        "properties": {
                          "ok": {
                            "type": "boolean"
                          },
                          "url": {
                            "type": "string"
                          },
                          "title": {
                            "type": "string"
                          },
                          "status": {
                            "type": "integer"
                          },
                          "markdown": {
                            "type": "string"
                          },
                          "word_count": {
                            "type": "integer"
                          },
                          "description": {
                            "type": "string"
                          }
                        }
                      }
                    },
                    "took_ms": {
                      "type": "integer"
                    },
                    "ok_count": {
                      "type": "integer"
                    },
                    "crawled_at": {
                      "type": "string"
                    },
                    "pages_crawled": {
                      "type": "integer"
                    },
                    "discovered_urls": {
                      "type": "integer"
                    },
                    "skipped_non_html": {
                      "type": "integer"
                    }
                  }
                },
                "success": {
                  "type": "boolean"
                }
              }
            }
          }
        }
      }
    },
    "category": "web"
  },
  "builder-code": {
    "info": {
      "a": "bc_q6wi3opd"
    }
  }
}

Provenance

Seen in the source catalog: 2026-10-22 11:19Z
Last indexed by Roundhouse: 2026-10-24 01:40Z
Last enriched (probe, favicon, geo): 2026-10-07 08:16Z
x402 version: 2
Max timeout: 300s
Liveness probe: HTTP 402

Report

Hand this page to an agent

Copy the prompt and paste it into Claude, an MCP client or your own agent — it will vet this service and call it over the free read API. No key, no account.

GET api.roundhouseai.io/v0/endpoints

This endpoint's own trailing-30-day call count, as published by the upstream catalog and snapshotted daily. 24 snapshots so far. Verified volume counts only settlements with an on-chain EIP-3009 marker.

Open skill.md

Show the prompt

Using Roundhouse, look up the x402 service Website Crawler to Markdown and tell me whether it is
worth paying: what a call costs, whether the endpoint answered when last probed, and what
its payment record actually shows.

curl -s 'https://api.roundhouseai.io/v0/endpoints?q=Website%20Crawler%20to%20Markdown'
curl -s 'https://api.roundhouseai.io/v0/merchants/<the payTo wallet returned above>'

Then call it: read the price from the live 402 at https://agentsvc.io/api/v1/proxy/site-crawl, never from
a cached figure, and pay with an x402 client.

The /v0 API needs an API key (`authorization: Bearer rh_live_…`) on everything except
/v0/unified* and /v0/endpoints. Either pay over x402 (mint a personal key for $0.01 at
GET https://api.roundhouseai.io/v0/test/x402), or ask me for an organization key, which I create at
https://roundhouseai.io/dashboard/connections. If you have neither, ask before going further.

If you do not have Roundhouse tools or skills installed, read
https://roundhouseai.io/skill.md first — it is the whole procedure.