Scan Only a Specified Directory:

This option tells Siteliner to only scan the specified directory. Simply enter the full URL of the directory you wish to scan into the main search box at the top of the page.

Siteliner will ignore your robots.txt file and scan only the directory that you specified. Using this option, only one directory may be specified at a time. If you wish to scan more than one specific directory using this option, you will have to run multiple scans, each for a different directory.

Please be sure to add the final "/" to the end of your URL if needed.

For example, if you are scanning your site (http://www.example.com) and wish to include only the pages in the 'business/banking' directory ('http://www.example.com/business/banking/'), you should enter the full URL of this directory into the main search field at the top of the page:

      http://www.example.com/business/banking/