Agent Accessibility Check

Paid x402 API for AI agents that checks robots.txt, sitemap availability, llms.txt discovery, AI crawler readiness, agent accessibility and AI scraping compatibility for a public URL.

Agent discoveryUse OpenAPI and the x402 catalog before calling paid endpoints.

openapi.json x402 catalog llms-full.txt

Call

Method: POST
URL: https://api.x402dataapi.com/v1/agent-accessibility
Price: 0.001 USDC
Network: eip155:8453
TTL: 900s
Timeout: 20000ms

Agent value

This endpoint returns structured JSON suitable for autonomous agents, scanners and workflow tools.

x402ai-agentsagent-accessibilityrobots.txtsitemap

Input schema

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "format": "uri",
      "description": "Public http or https URL to inspect"
    }
  },
  "required": [
    "url"
  ]
}

Input example

{
  "url": "https://example.com"
}

Output example

{
  "url": "https://example.com",
  "robots": {},
  "sitemap": {},
  "ai_ready": true
}

curl

curl -X POST https://api.x402dataapi.com/v1/agent-accessibility \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com"}'

Payment behavior

Paid endpoints return HTTP 402 with payment requirements when called without a valid x402 payment signature.

curl -X POST https://api.x402dataapi.com/v1/agent-accessibility \
  -H "Content-Type: application/json" \
  -H "PAYMENT-SIGNATURE: <x402-payment-payload>" \
  -d '{"url":"https://example.com"}'