All checks › Bot Access Control
Content Signals
Why it matters
Blocking or allowing a bot in a traditional robots.txt is an all-or-nothing decision about access. Content-Signal is more granular: it lets you say, for example, 'you may index for search, but you may not use my content to train a model'. It is the difference between controlling whether an agent gets in and controlling what it may do with what it finds.
Want to see how your site does?
The free scan runs this and every other check in about 30 seconds and shows the evidence for each one.
Scan my site for free