Discovery files
robots.txt, sitemap.xml, llms.txt, /.well-known/ai, and /.well-known/agents.json.
GET /llms.txt
SEO for autonomous agents
SEO was built for search engines and human clicks. ASO is built for AI shoppers, browser agents, research assistants, and buying bots that decide which links, products, and sources can be found, cited, recommended, invoked, paid for, and remembered in search-backed chat responses.
The next visitor who matters may not be human. If an AI shopper, browser agent, research assistant, or buying bot lands on your site tonight, will it understand what you sell, trust the source, and know what to do next? ASO gives you the score, framework, and free self-assessment to find the gaps before agents skip you.
Signal pillars
ARI max score
Launch artifacts
Readable manifests
The new traffic alarm
Product pages, booking flows, storefronts, APIs, directories, and service businesses are about to be judged by software that does not browse like a person. Agents look for explicit signals: what you do, what can be trusted, what can be invoked, what costs money, and where the canonical answer lives. If those signals are missing, the agent may skip you before a human ever sees the page.
Definition
SEO ranks pages for people. AEO, GEO, and LLMO improve answer visibility. ASO prepares services for agent selection, invocation, payment, and repeat use.
The easiest way to understand ASO is to start with the job SEO did for the web. SEO made pages legible to search engines so humans could find them. ASO makes services legible to autonomous agents so agents can choose, call, pay for, recommend, and return to them.
That shift changes the optimization target. A page can win SEO by being relevant and authoritative. A service wins ASO by being machine-readable, callable, trustworthy, priced clearly, and stable enough for an agent to remember.
Keywords, links, crawl health, content quality, and human click-through.
Retrievable explanations, citations, source authority, and brand mentions.
Manifests, callable specs, auth clarity, trust evidence, pricing, and durable memory.
SEO to ASO
ASO does not replace SEO. It extends the same basic idea into a world where the visitor may be an autonomous client instead of a human using a browser.
Some web properties carry over directly: `robots.txt` and `sitemap.xml` still matter. Others need agent-native companions. A blog post may help an answer engine cite you, but an agent needs a manifest, a callable contract, and explicit policy boundaries before it can safely use you.
Crawler access rules.
robots.txt plus AI crawler policySeparates indexing, retrieval, training, and agent access.
URL inventory for search engines.
sitemap.xml plus llms.txtPairs page inventory with a curated reading path for agents.
Human-facing result snippets.
agent.json and schema.orgMachine-readable identity, service type, owner, and capabilities.
Entity and content context.
OpenAPI, MCP, and manifestsCallable interface, parameters, auth, responses, and errors.
Authority signals.
registry listings and reputation signalsEvidence an agent can use to compare services and reduce risk.
Forms, CTAs, demos, and sales pages.
agent-safe invocation and payment pathDocumented auth, pricing, x402 or payment manifest, and constraints.
Humans remember and search again.
persistent service memoryAgents return through stable IDs, versioned docs, and consistent endpoints.
Agent Flow
A human can tolerate ambiguity. They can click around, infer intent, fill out a form, or ask sales what an API actually does. An agent has a narrower tolerance. If it cannot identify the service, verify the rules, and find a safe invocation path, it will usually choose another option.
ASO turns that fragile browsing process into a deterministic evaluation path. The agent finds public signals, resolves identity, checks trust and commerce constraints, invokes the service, then stores the service as a future candidate.
Signal Stack
A service becomes agent-readable when its public surface answers three questions without a sales call: what are you, how do I call you, and why should I trust you?
Discovery files are not the whole discipline, but they are where the agent starts. The first layer tells crawlers that a service exists. The next layers tell agents what the service does, how to call it, how risk is handled, and whether money can move without a human in the loop.
robots.txt, sitemap.xml, llms.txt, /.well-known/ai, and /.well-known/agents.json.
GET /llms.txt
agent.json, schema.org, service type, version, owner, canonical URLs, and compatibility.
GET /agent.json
OpenAPI, MCP, auth schemes, endpoint semantics, input constraints, errors, and examples.
GET /openapi.json
HTTPS, status, provenance, rate limits, governance, uptime, and operational boundaries.
GET /.well-known/status
Pricing, payment manifests, x402 routes, registry state, versioned docs, and stable return paths.
GET /.well-known/payments
Framework
The six pillars keep ASO from becoming a checklist of random files. Each pillar answers a decision an autonomous agent must make before it can use a service: can I find it, understand it, trust it, pay for it, compare it, and remember it?
Can agents find the service through crawl rules, maps, manifests, and directories?
Can agents understand the service name, owner, type, version, capabilities, and canonical endpoints?
Can agents verify domain, auth, governance, status, provenance, and operational safety?
Can agents understand pricing, payment requirements, x402 endpoints, and purchase constraints?
Can agents compare uptime, completion rates, citations, directory listings, and third-party evidence?
Can agents return through stable URLs, persistent identity, versioned docs, and consistent signals?
ASO Score
The Agent Readiness Index is a 0-100 score that grades how prepared a service is for autonomous agent discovery, evaluation, invocation, payment, recommendation, and reuse.
The score is intentionally concrete. A service should not receive credit for saying it is agent-ready. It receives credit for public signals an agent, auditor, or crawler can verify.
Read the scoring rubricReadiness vs ASO
Agent readiness scanners are a useful first pass. They check whether agents can find a site, read it, authenticate against it, discover protocols, and understand commerce surfaces. ASO turns the same signal hunt into a selection framework: identity, trust, commerce, reputation, memory, traffic, and conversion evidence.
Readiness checks answer: can agents inspect this site without guessing?
The Agent Readiness Index answers: how exposed, credible, and commercially useful are the signals?
The six pillars answer: what should be fixed before agent traffic starts choosing winners?
Certification answers: what was verified, when, and whether the claim survives inspection?
Can agents technically inspect, read, authenticate, and discover the service?
Will agents understand, trust, compare, choose, pay for, and remember the service?
Are agents actually finding, citing, invoking, converting, and returning?
What agents inspect
ASO treats every public artifact as evidence. Some signals help an agent find the service. Some make the content cheaper to read. Some define access rules, authentication, callable tools, or payment terms. The score matters because agents do not reward intent; they reward surfaces they can verify.
The agent is not browsing like a person. It is reducing risk.
Publish a crawl map before the agent has to guess.
robots.txt with AI crawler rulessitemap.xml with canonical URLsLink headers for machine resourcesGive agents clean text paths instead of forcing HTML scraping.
llms.txt as the agent reading guideAccept: text/markdown/index.md fallbacks for important pagesSeparate search, grounding, training, and signed bot access.
Content-Signal directives in robots.txt/.well-known/http-message-signatures-directoryExpose APIs, tools, auth metadata, and task instructions.
/.well-known/api-catalog for API discoveryauth.md for auth instructionsHuman checkout is not enough for autonomous buying flows.
/.well-known/payments or payment manifestASO turns scattered checks into a repeatable evidence trail.
Accept: text/markdown.
A full crawler should still add automated checks for DNS-AID, Web Bot
Auth, API Catalog, OAuth metadata, Auth.md, MCP Server Cards, A2A
Agent Cards, Agent Skills, WebMCP, and agentic commerce protocols.
A static reference site needs discovery, readable source files, manifests, status, and verification. It does not need OAuth, MCP, API Catalog, or x402 until it exposes protected resources, callable tools, APIs, or autonomous payment flows.
Prioritize robots.txt, sitemap.xml, llms.txt, Markdown pages, schema, manifests, status, and citations.
Add OpenAPI, API Catalog, auth docs, OAuth metadata, uptime, rate limits, pricing, and support paths.
Add MCP Server Card, Agent Skills, tool schemas, transport details, auth rules, versioning, and invocation examples.
Add machine-readable pricing, payment manifests, purchase limits, refund rules, x402 or other agentic commerce protocols.
Accept: text/markdown.
Implemented for the homepage with a Cloudflare Pages Function and /index.md fallback.
Content-Signal rules to robots.txt once your policy is clear.
/.well-known/api-catalog once you have callable public APIs.
ASO Scanner
This is the quick gut check for whether your site is visible to the next wave of AI-mediated traffic. Mark the public signals you already expose, get an ASO level, then fix the gaps agents are most likely to punish.
The self-assessment is intentionally transparent: every checkbox maps to a public signal an agent, auditor, or crawler can inspect. That makes the score useful for anyone whose revenue depends on being found, trusted, quoted, booked, bought, or recommended by software before a person clicks.
No agent signals selected yet.
ASO Services
The service ladder follows the evidence trail: audit the public surface, document remediation, monitor signal drift, list verified services in a registry, then certify maturity levels with public proof.
Manual and automated reviews across the six pillars.
Executive summary plus engineering remediation plan.
Signal drift, crawler access, manifest validity, and reputation checks.
Verified reference index for services with clear agent signals.
Evidence-backed maturity levels for ASO-3 through ASO-5.
Certification
A useful ASO certificate tells an agent and a human buyer what has actually been checked. It should point to the registry entry, the score band, the verification date, and the public artifacts that supported the decision.
Certification works like an audit trail. A service is scanned or manually reviewed against the ASO rubric, missing signals are documented, fixes are verified, and the final result is published as a registry-backed certificate with a score band and expiration date.
It is useful because agents and buyers both need shorthand for trust. A badge is not the product; the evidence behind the badge is. ASO certification is an offer built on audits, remediation reports, registry records, and periodic re-verification.
Check crawl access, manifests, schemas, callable specs, auth, pricing, trust, and memory signals.
Validate syntax, reachable URLs, consistency across files, operational claims, and registry eligibility.
Publish score band, verification date, artifacts checked, limitations, and renewal window.
Verified discovery, identity, documentation, and a callable interface such as OpenAPI or MCP.
ASO-3 plus verified trust, status, governance, reputation, and operational safety signals.
ASO-4 plus machine-readable pricing, payment support, agent-safe purchase rules, and return paths.
Reference Position