Agent Exchange x402 census and directory

x402 census · freetier-agent-api.pages.dev · 9bc81af8a5a3 · JSON

GET /api/robots-check

live

Check whether a URL may be crawled per the site's robots.txt for a given user-agent. Returns allowed, matched rule, crawl-delay, sitemaps.

Verdict: live. The unpaid GET reached a valid 402. The live amount equals the catalog price.

Facts from the catalogs

FieldValue
URLhttps://freetier-agent-api.pages.dev/api/robots-check
MethodGET
Price$0.003 USDC = 3000 atomic units of 0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913
Networkeip155:8453 (base)
payTo0x165Eb3dC3E98403ecB1141e90400F5e71806554B
Sellerfreetier-agent-api.pages.dev
Catalogscdp (row updated 2026-10-31), payai (row updated 2026-10-26)
Listed since (lower bound)2026-10-26 (earliest catalog timestamp; catalogs report last-update times only)
Last catalog update2026-10-31
CDP quality counters1 calls and 1 unique payers in 30 days, last call 2026-10-31 (catalog-reported, not verified on chain)
Category (keyword rule)scrape/browser
Templated pathno
x402Version in catalog2
Service name / tagsAgent Extraction API · web, robots-txt, crawling, compliance

Unpaid probe (census of 2026-11-18)

FieldValue
Probed at2026-11-18T02:04:21.967Z
HEAD402
GET402
Verdictlive live: valid 402 to an unpaid GET
402 carried inheader+body
x402Version in the 4021
accepts[0]{"scheme":"exact","network":"base","amount":"3000","payTo":"0x165Eb3dC3E98403ecB1141e90400F5e71806554B","asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","maxTimeoutSeconds":300,"extra":{"name":"USD Coin","version":"2"}}
Live amount equals catalog priceyes
Live payTo equals catalog payToyes
extensions.bazaar in the 402yes
PAYMENT-REQUIRED headeryes
WWW-Authenticate offernone
Content type / server / CORSapplication/json / cloudflare / *
Latency292 ms
ErrorPayment required: $0.003 USDC on Base. Send PAYMENT-SIGNATURE (x402 v2) or X-PAYMENT (x402 v1). To use your 1 free call,

No hourly re-probe has reached this resource yet; the cron covers a rotating slice of 150 per hour.

On-chain facts for the payTo (public address)

FieldValue
Settlement historyunresolved: payTo not seen in the payer forensics (180 wallets' outbound history) or the Blockscout sample

Declared input and output (extensions.bazaar)

{
 "input": {
  "method": "GET",
  "queryParams": {
   "ua": "MyAgent",
   "url": "https://example.com/some/page"
  },
  "type": "http"
 },
 "output": {
  "type": "json",
  "example": {
   "allowed": true,
   "crawl_delay": null,
   "matched_rule": null,
   "robots_status": 404,
   "sitemaps": [],
   "sources": [
    {
     "name": "robots.txt (live)",
     "url": "https://example.com/robots.txt"
    }
   ],
   "url": "https://example.com/some/page",
   "user_agent": "MyAgent"
  }
 }
}

Try it (unpaid: shows the 402)

curl -si -X GET 'https://freetier-agent-api.pages.dev/api/robots-check' -H 'accept: application/json'

The catalog declares GET. A 402 answer carries the payment requirements in the JSON body and, for x402 v2, base64 in the PAYMENT-REQUIRED header. This page never sends a payment.

Paid checks (x402, USDC on Base)

GET https://bazaar.agentexchange.work/r/9bc81af8a5a3/probe.json re-runs this probe right now for $0.01 and writes the result here. POST https://bazaar.agentexchange.work/featured with {"id":"9bc81af8a5a3"} places this resource at the top of the report and search pages for 30 days for $1.00, labelled. Unpaid requests answer 402 with the terms. Pricing.

Catalog references: PayAI listing status · agentic.market (CDP Bazaar front end) · this record as JSON · all resources on freetier-agent-api.pages.dev.