x402 census · payai.agentstools.dev · 94424c5c264f · JSON

GET /aeo/crawlers

live

robots.txt AI-crawler access matrix: for the 2026 cohort of AI and answer-engine crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended and more) reports allowed, blocked or unlisted per bot, whether the default rule blocks everything, declared sitemaps and a score. One network operation.

Verdict: live. The unpaid GET reached a valid 402 (confirmed by the re-probe of 2026-10-03). The live amount equals the catalog price.

Facts from the catalogs

Field Value

URL https://payai.agentstools.dev/aeo/crawlers

Method GET

Price $0.005 USDC = 5000 atomic units of EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v

Network solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp (solana)

payTo AytHnvc6bZx1ALTy7b5Px7hcavoSYszG9aeKvDcZ8R1u

Seller payai.agentstools.dev

Catalogs payai (row updated 2026-09-30)

Listed since (lower bound) 2026-09-30 (earliest catalog timestamp; catalogs report last-update times only)

Last catalog update 2026-09-30

CDP quality counters not in the CDP catalog

Category (keyword rule) inference/llm

Templated path no

x402Version in catalog 2

Service name / tags aeo-crawlers · aeo, robots-txt, ai-crawler, gptbot, claudebot

Unpaid probe (census of 2026-09-30)

Field Value

Probed at 2026-09-30T23:41:19.964Z

HEAD 402

GET 402

Verdict live live: valid 402 to an unpaid GET

402 carried in header+body

x402Version in the 402 2

accepts[0] {"scheme":"exact","network":"eip155:8453","amount":"5000","payTo":"0xF22e558a00D91Ee12A1F50C52186FecB8dDFf493","asset":"0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913","maxTimeoutSeconds":300,"extra":{"name":"USD Coin","version":"2"}}

Live amount equals catalog price yes

Live payTo equals catalog payTo no

extensions.bazaar in the 402 yes

PAYMENT-REQUIRED header yes

WWW-Authenticate offer none

Content type / server / CORS application/json / uvicorn / none

Latency 1,880 ms

Error Payment required

Latest re-probe

Field Value

Re-probed at 2026-10-03T06:13:27.000Z (cron)

Verdict now live unchanged

HEAD / GET 402 / 402

Live amount equals catalog price yes

Latency 1,762 ms

Error none

On-chain facts for the payTo (public address)

Field

Value

Settlement history

unresolved: non-EVM payTo; only Base is covered

Declared input and output (extensions.bazaar)

{
 "input": {
  "type": "http",
  "method": "GET",
  "queryParams": {
   "domain": "example.com"
  }
 },
 "output": {
  "type": "json",
  "example": {
   "fixes": [],
   "domain": "example.com",
   "disclaimer": "Automated AI-search visibility indicators, not a guarantee.",
   "crawler_score": 100,
   "crawler_matrix": [
    {
     "bot": "PerplexityBot",
     "access": "allowed",
     "listed": false,
     "operator": "Perplexity",
     "citation_relevant": true
    }
   ],
   "robots_present": true,
   "default_blocks_all": false
  }
 }
}

Try it (unpaid: shows the 402)

curl -si -X GET 'https://payai.agentstools.dev/aeo/crawlers' -H 'accept: application/json'

The catalog declares GET. A 402 answer carries the payment requirements in the JSON body and, for x402 v2, base64 in the PAYMENT-REQUIRED header. This page never sends a payment.

Paid checks (x402, USDC on Base)

GET https://bazaar.agentexchange.work/r/94424c5c264f/probe.json re-runs this probe right now for $0.01 and writes the result here. POST https://bazaar.agentexchange.work/featured with {"id":"94424c5c264f"} places this resource at the top of the report and search pages for 30 days for $1.00, labelled. Unpaid requests answer 402 with the terms. Pricing.

Catalog references: PayAI listing status · this record as JSON · all resources on payai.agentstools.dev.