Skip to content
R4BReady4Bots

What helps agents

These are general notes on how a public website can be reached by an automated customer agent. This page does not name or score any business, and it is not an offer of services.

Identify the agent

A stable user-agent string, and a signed agent identity such as Web Bot Auth, lets a site tell a known agent from anonymous traffic.

Say what happened

If a request is refused, an HTTP status and a short plain-text reason are easier to record than an empty page. Nothing here says a site must allow every agent.

Accounts and guest checkout

Some purchases require an account. That can be a legitimate business choice, especially for downloads, subscriptions, and repeat orders. If guest checkout exists, put it on the same step as sign-in so an agent can see it.

A machine-readable catalog

A public product or booking feed, an OpenAPI document, or an MCP server gives an agent a path that does not depend on clicking through a layout made for people.

Opt out of this test

A site can refuse the Ready4Bots test agent in robots.txt:

User-agent: Ready4BotsBot
Disallow: /

A site that opts out is not listed as having failed a test.

What helps agents · Ready4Bots