x402 census · intel.rallylive.ca · 686f6bdd7c90 · JSON
POST /dev/ai-crawler-policy
live
AI-crawler policy of a website: reads robots.txt and reports, for 20 known AI/LLM crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, anthropic-ai, CCBot, Google-Extended, Applebot-Extended, PerplexityBot, Bytespider, Amazonbot, cohere-ai, meta-externalagent and more), whether the root is allowed, blocked or unmentioned, plus an overall stance (open / selective / blocks-all-ai) and TDM/ai.t…
Verdict: live. The unpaid GET reached a valid 402. The live amount equals the catalog price.
Facts from the catalogs
| Field | Value |
|---|---|
| URL | https://intel.rallylive.ca/dev/ai-crawler-policy |
| Method | POST |
| Price | $0.01 USDC = 10000 atomic units of 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913 |
| Network | eip155:8453 (base); also accepts eip155:84532 |
| payTo | 0x91D568599fB802Cb3f03F067D2063785dBAF0abd |
| Seller | intel.rallylive.ca |
| Catalogs | cdp (row updated 2026-09-13), payai (row updated 2026-09-28) |
| Listed since (lower bound) | 2026-09-13 (earliest catalog timestamp; catalogs report last-update times only) |
| Last catalog update | 2026-09-28 |
| CDP quality counters | 2 calls and 2 unique payers in 30 days, last call 2026-09-13 (catalog-reported, not verified on chain) |
| Category (keyword rule) | inference/llm |
| Templated path | no |
| x402Version in catalog | 2 |
| Service name / tags | ai-crawler-policy · ai-crawlers, robots, gptbot, claudebot, policy |
Unpaid probe (census of 2026-09-30)
| Field | Value |
|---|---|
| Probed at | 2026-09-30T23:36:39.457Z |
| HEAD | 402 |
| GET | 402 |
| Verdict | live live: valid 402 to an unpaid GET |
| 402 carried in | header |
| x402Version in the 402 | 2 |
| accepts[0] | {"scheme":"exact","network":"eip155:8453","amount":"10000","payTo":"0xFC24FD34da9e49A0110DCaEe3Ad30eC54175eBB3","asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","maxTimeoutSeconds":120,"extra":{"name":"USD Coin","version":"2"}} |
| Live amount equals catalog price | yes |
| Live payTo equals catalog payTo | no |
| extensions.bazaar in the 402 | yes |
| PAYMENT-REQUIRED header | yes |
| WWW-Authenticate offer | none |
| Content type / server / CORS | application/json / cloudflare / none |
| Latency | 1,604 ms |
| Error | Payment required |
No hourly re-probe has reached this resource yet; the cron covers a rotating slice of 150 per hour.
On-chain facts for the payTo (public address)
| Field | Value |
|---|---|
| Distinct payers | 1 |
| Payments | 50 |
| USDC volume | $0.50 |
| Median payment | n/a |
| First / last payment | 2026-09-13 / 2026-09-13 |
| Sampler-shaped share of payments | n/a |
| Payers that are not samplers | n/a |
| Source | blockscout-sample — newest page of inbound ERC-20 transfers only (<=50); counts are a floor, not a total |
| Address | 0x91D568599fB802Cb3f03F067D2063785dBAF0abd |
Declared input and output (extensions.bazaar)
{
"input": {
"body": {
"domain": "nytimes.com"
},
"bodyType": "json",
"method": "POST",
"type": "http"
},
"output": {
"type": "json",
"example": {
"allowed": [],
"blocked": [
"GPTBot",
"ClaudeBot"
],
"domain": "nytimes.com",
"has_ai_txt": false,
"has_tdm_reservation": false,
"stance": "blocks-all-ai",
"unmentioned": []
}
}
}
Try it (unpaid: shows the 402)
curl -si -X POST 'https://intel.rallylive.ca/dev/ai-crawler-policy' -H 'accept: application/json' -H 'content-type: application/json' --data '{}'
The catalog declares POST. A 402 answer carries the payment requirements in the JSON body and, for x402 v2, base64 in the PAYMENT-REQUIRED header. This page never sends a payment.
Paid checks (x402, USDC on Base)
GET https://bazaar.agentexchange.work/r/686f6bdd7c90/probe.json re-runs this probe right now for $0.01 and writes the result here. POST https://bazaar.agentexchange.work/featured with {"id":"686f6bdd7c90"} places this resource at the top of the report and search pages for 30 days for $1.00, labelled. Unpaid requests answer 402 with the terms. Pricing.
Catalog references: PayAI listing status · agentic.market (CDP Bazaar front end) · this record as JSON · all resources on intel.rallylive.ca.