x402 census · api.strale.io · 4355668ebc1f · JSON

GET /x402/robots-txt-parse

live

Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.

Verdict: live. The unpaid GET reached a valid 402. The live amount equals the catalog price.

Facts from the catalogs

Field Value

URL https://api.strale.io/x402/robots-txt-parse

Method GET

Price $0.02 USDC = 21600 atomic units of 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913

Network base (base)

payTo 0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC

Seller api.strale.io

Catalogs cdp (row updated 2026-09-19)

Listed since (lower bound) 2026-09-19 (earliest catalog timestamp; catalogs report last-update times only)

Last catalog update 2026-09-19

CDP quality counters 3 calls and 1 unique payers in 30 days, last call 2026-09-19 (catalog-reported, not verified on chain)

Category (keyword rule) scrape/browser

Templated path no

x402Version in catalog 1

Service name / tags none

Unpaid probe (census of 2026-09-30)

Field Value

Probed at 2026-09-30T23:56:08.121Z

HEAD 402

GET 402

Verdict live live: valid 402 to an unpaid GET

402 carried in body

x402Version in the 402 1

accepts[0] {"scheme":"exact","network":"base","amount":"21600","payTo":"0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC","asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","maxTimeoutSeconds":300,"extra":{"name":"USD Coin","version":"2"}}

Live amount equals catalog price yes

Live payTo equals catalog payTo yes

extensions.bazaar in the 402 yes

PAYMENT-REQUIRED header no

WWW-Authenticate offer none

Content type / server / CORS application/json / railway-hikari / *

Latency 1,714 ms

Error Payment required. Robots.txt Parse costs $0.0216 USDC per call.

No hourly re-probe has reached this resource yet; the cron covers a rotating slice of 150 per hour.

On-chain facts for the payTo (public address)

Field Value

Distinct payers 10

Payments 40

USDC volume $1.97

Median payment $0.03

First / last payment 2026-07-21 / 2026-09-30

Sampler-shaped share of payments 100.0%

Payers that are not samplers 0

Source forensics-2026-09-30

Address 0x66D7C2F952362BFB24FD7F02a9beC9c754ea83bC

Declared input and output (extensions.bazaar)

{
 "input": {
  "method": "GET",
  "queryParams": {
   "url": {
    "required": true,
    "type": "string"
   }
  },
  "type": "http"
 },
 "output": {}
}

Try it (unpaid: shows the 402)

curl -si -X GET 'https://api.strale.io/x402/robots-txt-parse' -H 'accept: application/json'

The catalog declares GET. A 402 answer carries the payment requirements in the JSON body and, for x402 v2, base64 in the PAYMENT-REQUIRED header. This page never sends a payment.

Paid checks (x402, USDC on Base)

GET https://bazaar.agentexchange.work/r/4355668ebc1f/probe.json re-runs this probe right now for $0.01 and writes the result here. POST https://bazaar.agentexchange.work/featured with {"id":"4355668ebc1f"} places this resource at the top of the report and search pages for 30 days for $1.00, labelled. Unpaid requests answer 402 with the terms. Pricing.

Catalog references: agentic.market (CDP Bazaar front end) · this record as JSON · all resources on api.strale.io.