Use Temporary robots.txt file:
This option tells Siteliner to ignore your regular robots.txt file, and instead use a temporary robots.txt file that you enter.
For more information about robots.txt files and syntax, please see here. For more information about the Siteliner Bot, please see here.
|
|