Free tools for AI agent readiness

Build a robots.txt with explicit rules for AI crawlers like GPTBot, ClaudeBot, PerplexityBot, and Google-Extended. Presets, sitemap line, copy-ready output.

Paste a robots.txt, a URL path, and a user agent. See whether it is allowed using the Google matching algorithm: longest match wins, Allow beats Disallow on tie.

Paste JSON-LD or a script tag and validate schema.org structure, required fields per type, and rich result eligibility for Article, FAQPage, BreadcrumbList, and more.

Paste a sitemap.xml and validate the structure, URL count, oversize warnings, lastmod date format, changefreq enum, priority range, and per-URL field issues.

Paste an RSS or Atom feed and validate the structure, required elements, dates, and uniqueness. Links out to the W3C Feed Validation Service for an authoritative check.

Create an llms.txt that gives autonomous agents a structured map of your most important pages and APIs. Sections, links, and short summaries in markdown.

Bundle markdown blocks into a single llms-full.txt for deep AI ingestion. Add titles, source URLs, see a token estimate, then copy or download the file.

Generate JSON-LD structured data for Organization, WebSite, FAQPage, BreadcrumbList, and Article without writing JSON by hand. Validates against Google rich results.

Generate Open Graph and Twitter Card meta tags with a live preview that shows how your URL renders when shared on social platforms. Copy a paste-ready block.

Compose a Content-Signal directive that declares your AI training, search, and AI-input preferences. Choose allow or disallow per signal and copy a robots.txt line.

Compose RFC 8288 Link headers for agent-friendly discovery of api-catalog, sitemap, llms.txt, and feeds. Outputs a single header value plus a Next.js proxy snippet.

Paste URLs to get a valid sitemap.xml with optional lastmod, changefreq, and priority. Validates each URL and produces a downloadable sitemaps.org-conformant file.

Reference of AI crawler user agents with quick toggles to generate allow or disallow rules for each. Includes owner, purpose, and notes for 15 major bots.

Paste a User-Agent string and identify whether it belongs to a known AI crawler, search bot, social previewer, or browser. Detects 45+ common agents instantly.

Generate a /.well-known/agent-card.json so A2A clients can discover your agent's identity, capabilities, and skills. Includes a Next.js route handler snippet.

Generate a Linkset for /.well-known/api-catalog so agents can discover every API on your site. Includes a drop-in Next.js route handler snippet (RFC 9727).

Copy-paste Next.js proxy.ts and route handler snippets that return text/markdown when an agent sends Accept: text/markdown. Browsers still receive HTML.