Content-Signal Builder for robots.txt
Pick allow or disallow values for ai-train, search, and ai-input, then copy a single Content-Signal line ready to drop into robots.txt.
Quick presets
Signals
ai-train
Allow content to be used to train AI models. Set no if you do not want your content used for model training.
search
Allow indexing for search results, including AI search products. Most public sites set yes.
ai-input
Allow content to be used as live input for AI features such as RAG and answer engines.
Single Content-Signal directive
text · 1 line · 52 B
Content-Signal: ai-train=no, search=yes, ai-input=no
Drop-in robots.txt block
text · 3 lines · 75 B
User-agent: * Allow: / Content-Signal: ai-train=no, search=yes, ai-input=no
Apply this with your coding agent
Get a ready-made prompt that wraps the output above with implementation steps. Paste it into your AI assistant and let it ship the change.
About Content-Signal
Content-Signal is a robots.txt extension that lets you express AI-specific content-use preferences. It is parsed by AI vendors that opt to support it and is read alongside standard User-agent rules.
Place the directive inside a User-agent group. For a site-wide rule, put it under User-agent: *. Adoption is voluntary, so also add explicit Disallow rules for the bots you want to block.
Verify on a real URL
Run a full agent readiness scan to see how your live site responds end to end.