Jump to content

Do I need a robots txt file WordPress?


eCommerceChamp

Recommended Posts

 Robots.txt is a text file that website owners can create to tell search engine bots how to crawl and index pages on their site. You can have multiple lines of instructions to allow or disallow specific URLs and add multiple sitemaps. Lastly, we have provided the URL of our XML sitemap.

Link to comment
Share on other sites

You can test your WordPress robots.txt file in Google Search Console to ensure it's setup correctly. Simply click into your site, and under “Crawl” click on “robots.txt Tester.” You can then submit any URL, including your homepage. You should see a green Allowed if everything is crawlable.

Link to comment
Share on other sites

  • 2 weeks later...

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...