Manage robots.txt
A robots.txt file is a text file that is placed on websites to provide instructions to crawlers. These instructions tell search engines which parts of the website should be crawled and indexed and which parts should be excluded from indexing.
Create robots.txt
- Go to
Add-Ons > Sitemap Add-On > Robots Management
. - Click on Add Robots.
- Select shop country for which the robots.txt should be generated.
- Enter the robots.txt content following the robot.txt guidelines by Google.
- Click SAVE.