The file robots.txt is an industry standard that search engines use to find out what aspects of a site they are allowed to interact with an any areas that they should avoid. This tutorial will explain how to create a custom robots.txt file to instruct the search engine crawlers to behave differentdifferently.
First let's look at the default robots.txt file that UltraCart serves up if nothing is configured on your StoreFront.
...