Can I edit the content of my robots.txt file ?

Robots.txt is auto-generated but yes, you can edit it to tell web crawlers what sections, files and folders you want to be crawled and what should not be crawled. 

Was this article helpful?


Can't find what you're looking for?

Contact our support team and we'll help you out

Contact Support