Skip to content

enUSD

Log in Live demo

Language · Currency

Log in Live demo

Crawlers, sitemaps and AI

Check your sitemap and robots.txt, choose which AI crawlers may read your site, and tell search engines about changes straight away.

XML sitemap in WordPress: where yours is and how to check it
Where the sitemap is, what it includes and how to read its health panel.
Edit robots.txt in WordPress
Change your robots.txt safely from WordPress, with checks that stop you blocking search engines by mistake.
Choose which AI crawlers may read your site
Allow the crawlers that answer questions with a link to you, block the ones that only train models, or make your own choice.
llms.txt for WordPress: publish yours for AI assistants
llms.txt gives AI assistants a short, curated map of your most important pages.
Switch on IndexNow
IndexNow tells Bing, Yandex, Seznam, Naver and other search engines the moment a page is published, changed or removed, and you can send any page by hand from its row in the list.
Switch on no-trace mode
No-trace mode hides which SEO plugin the site runs. Every address that changes is listed before you confirm.
Clean up what WordPress adds to every page
Remove the extra links, feeds and address variations WordPress makes, so search engines spend their time on your real pages.
Keep thin pages out of search results
Password pages, empty categories, comment pages and feeds are kept out of search results for you, and every rule can be changed.
Edit .htaccess and Nginx rules safely (Pro)
Change your server rules with a syntax check, a backup of every version and an automatic undo if the site stops answering.
Send pages to search engines by hand
Tell Bing, the IndexNow search engines and Google about any page the moment you want it found, keep the pages you choose out of automatic sending, and see what each search engine answered, with one click to send again.