x402 census · agent-data.centorprat.workers.dev · 773874259868 · JSON
POST /tools/robots-sitemap-analyzer
blocked
Give it domains. For each it parses robots.txt (user-agents, allow/disallow, crawl-delay, declared sitemaps, blocks-all) and the XML sitemap(s) (URL counts, nested sitemaps, lastmod coverage), and flags crawlability issues - with a signal and findings. Keyless, read-only. Up to 3 items per call; failed lookups are not charged.
Verdict: not verified by an unpaid GET. 401/403/429: auth or bot protection. This says nothing about whether the route works when called as declared.
Facts from the catalogs
| Field | Value |
|---|---|
| URL | https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer |
| Method | POST |
| Price | $0.02 USDC = 20000 atomic units of 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913 |
| Network | eip155:8453 (base); also accepts eip155:137, solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp |
| payTo | 0x8d38D6026cf3A9805DE9c5F0611ceE95B532B120 |
| Seller | agent-data.centorprat.workers.dev |
| Catalogs | cdp (row updated 2026-10-25) |
| Listed since (lower bound) | 2026-10-25 (earliest catalog timestamp; catalogs report last-update times only) |
| Last catalog update | 2026-10-25 |
| CDP quality counters | 4 calls and 2 unique payers in 30 days, last call 2026-10-25 (catalog-reported, not verified on chain) |
| Category (keyword rule) | trading-signals |
| Templated path | no |
| x402Version in catalog | 2 |
| Service name / tags | robots.txt & Sitemap Analyzer · seo-tools, developer-tools, data |
Unpaid probe (census of 2026-10-25)
| Field | Value |
|---|---|
| Probed at | 2026-10-25T21:14:27.952Z |
| HEAD | 429 |
| GET | 429 |
| Verdict | blocked 401/403/429: auth or bot protection |
| 402 carried in | n/a |
| x402Version in the 402 | n/a |
| accepts[0] | none |
| Live amount equals catalog price | not comparable |
| Live payTo equals catalog payTo | not comparable |
| extensions.bazaar in the 402 | no |
| PAYMENT-REQUIRED header | no |
| WWW-Authenticate offer | none |
| Content type / server / CORS | application/json / cloudflare / * |
| Latency | 767 ms |
| Error | none |
No hourly re-probe has reached this resource yet; the cron covers a rotating slice of 150 per hour.
On-chain facts for the payTo (public address)
| Field | Value |
|---|---|
| Settlement history | unresolved: payTo not seen in the payer forensics (180 wallets' outbound history) or the Blockscout sample |
Declared input and output (extensions.bazaar)
{
"input": {
"body": {
"domains": [
"apple.com"
]
},
"bodyType": "json",
"method": "POST",
"type": "http"
},
"output": {
"type": "json",
"example_truncated": true,
"chars": 1785
}
}
Try it (unpaid: shows the 402)
curl -si -X POST 'https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer' -H 'accept: application/json' -H 'content-type: application/json' --data '{}'
The catalog declares POST. A 402 answer carries the payment requirements in the JSON body and, for x402 v2, base64 in the PAYMENT-REQUIRED header. This page never sends a payment.
Paid checks (x402, USDC on Base)
GET https://bazaar.agentexchange.work/r/773874259868/probe.json re-runs this probe right now for $0.01 and writes the result here. POST https://bazaar.agentexchange.work/featured with {"id":"773874259868"} places this resource at the top of the report and search pages for 30 days for $1.00, labelled. Unpaid requests answer 402 with the terms. Pricing.
Catalog references: agentic.market (CDP Bazaar front end) · this record as JSON · all resources on agent-data.centorprat.workers.dev.