Meta robots
The tag inside the HTML head. Most CMS plugins write here, and most accidents happen here.
Noindex tag checker
A missing page is often not a crawling mystery. It is a noindex instruction left behind by a plugin, a staging site, or a theme setting.
We read both places that instruction can live: the meta robots tag in the HTML and the X-Robots-Tag in the response headers.
example.com/growth-guide
Meta robots
index, follow
Not blocking
X-Robots-Tag
not set
Not blocking
Nothing on this page tells search engines to stay away. If it is still missing from the index, the cause is elsewhere.
The tag inside the HTML head. Most CMS plugins write here, and most accidents happen here.
A header set by the server or CDN. It is invisible in the page source, which is why it gets missed for months.
A page pointing its canonical elsewhere is asking to be ignored, even without a noindex tag.
Keep going
Start here. Check any page against Google and Bing in seconds, free.
Open toolSubmit a page to the indexing endpoints we support and keep a record of when you last asked.
Open toolPaste a list, upload a CSV or TXT file, or send the batch through the API. Results come back as one clean table.
Open tool