x402 census · intel.rallylive.ca · e09648d28372 · JSON

POST /monitor/robots-allowed

live

Is a URL crawlable? Fetches the site's robots.txt and evaluates the given path for a specific user-agent (Googlebot, GPTBot, ClaudeBot, Bingbot or any token; default *), returning allowed/disallowed, the matching rule, the group used, crawl-delay and declared sitemaps. Pre-flight for crawlers and SEO checks. $0.01 per check.

Verdict: live. The unpaid GET reached a valid 402. The live amount equals the catalog price.

Facts from the catalogs

Field Value

URL https://intel.rallylive.ca/monitor/robots-allowed

Method POST

Price $0.01 USDC = 10000 atomic units of 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913

Network eip155:8453 (base); also accepts eip155:84532

payTo 0x91D568599fB802Cb3f03F067D2063785dBAF0abd

Seller intel.rallylive.ca

Catalogs cdp (row updated 2026-09-13), payai (row updated 2026-09-28)

Listed since (lower bound) 2026-09-13 (earliest catalog timestamp; catalogs report last-update times only)

Last catalog update 2026-09-28

CDP quality counters 3 calls and 2 unique payers in 30 days, last call 2026-09-13 (catalog-reported, not verified on chain)

Category (keyword rule) inference/llm

Templated path no

x402Version in catalog 2

Service name / tags crawl-allowed-check · robots, crawl, allowed, user-agent, seo

Unpaid probe (census of 2026-09-30)

Field Value

Probed at 2026-09-30T23:25:31.081Z

HEAD 402

GET 402

Verdict live live: valid 402 to an unpaid GET

402 carried in header

x402Version in the 402 2

accepts[0] {"scheme":"exact","network":"eip155:8453","amount":"10000","payTo":"0xFC24FD34da9e49A0110DCaEe3Ad30eC54175eBB3","asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","maxTimeoutSeconds":120,"extra":{"name":"USD Coin","version":"2"}}

Live amount equals catalog price yes

Live payTo equals catalog payTo no

extensions.bazaar in the 402 yes

PAYMENT-REQUIRED header yes

WWW-Authenticate offer none

Content type / server / CORS application/json / cloudflare / none

Latency 1,948 ms

Error Payment required

No hourly re-probe has reached this resource yet; the cron covers a rotating slice of 150 per hour.

On-chain facts for the payTo (public address)

Field Value

Distinct payers 1

Payments 50

USDC volume $0.50

Median payment n/a

First / last payment 2026-09-13 / 2026-09-13

Sampler-shaped share of payments n/a

Payers that are not samplers n/a

Source blockscout-sample — newest page of inbound ERC-20 transfers only (<=50); counts are a floor, not a total

Address 0x91D568599fB802Cb3f03F067D2063785dBAF0abd

Declared input and output (extensions.bazaar)

{
 "input": {
  "body": {
   "query": "https://github.com/features | Googlebot"
  },
  "bodyType": "json",
  "method": "POST",
  "type": "http"
 },
 "output": {
  "type": "json",
  "example": {
   "allowed": true,
   "crawl_delay": null,
   "group": "*",
   "matched_rule": null,
   "sitemaps": [],
   "url": "https://github.com/features",
   "user_agent": "Googlebot"
  }
 }
}

Try it (unpaid: shows the 402)

curl -si -X POST 'https://intel.rallylive.ca/monitor/robots-allowed' -H 'accept: application/json' -H 'content-type: application/json' --data '{}'

The catalog declares POST. A 402 answer carries the payment requirements in the JSON body and, for x402 v2, base64 in the PAYMENT-REQUIRED header. This page never sends a payment.

Paid checks (x402, USDC on Base)

GET https://bazaar.agentexchange.work/r/e09648d28372/probe.json re-runs this probe right now for $0.01 and writes the result here. POST https://bazaar.agentexchange.work/featured with {"id":"e09648d28372"} places this resource at the top of the report and search pages for 30 days for $1.00, labelled. Unpaid requests answer 402 with the terms. Pricing.

Catalog references: PayAI listing status · agentic.market (CDP Bazaar front end) · this record as JSON · all resources on intel.rallylive.ca.