<<< Project Functions
Home Page settings for the Imported File >>>
Beside generation of a new standard instructions file, the program also offers an option of importing an existing file from local PC, remote FTP server, or a remote HTTP server. The Import Wizard may be run from the spider list page, by selecting the menu item Import robots.txt file in the Project menu .
The import procedure is implemented in the form of the three-step wizard:
- Selecting import location
- Selecting a file for import
- Importing.
The process may be terminated at any step of the Wizard.
Selecting import location
You may select from local PC, remote FTP server or remote HTTP server.
Selecting file for import
If you have selected local PC, you may select the folder and file for import by pressing Browse... button or by entering the direct path in the space provided.
In case you selected a remote FTP server, you'll need to enter the FTP address without prefix, like: ftp.server.com, port (default value is 21), user name and password to establish a connection to the server where the file is stored, as well as file name. If you are not sure about the full path and/or file name, press FTP Browse button. A window will appear, which will let you determine a full path to the file you need to import.
If you select a remote HTTP server as a source for import, then on the Step 2 you will be asked to provide a URL of the site and name of the file you want to import (default name is robots.txt). Then press the Get button. The file will be downloaded. You may terminate the download process at any time by pressing the Terminate button. If the file is received successfully, you'll receive a success message and the program will proceed to the next step.
Importing
At this step the importing itself takes place, and results are displayed in the log window of the importing stages. If the importing is successful, the imported file is analyzed. If it contains User-Agents that are not present on the spider list at spider list page, then a corresponding record is being made in the log window. If the imported file contains a directive, not supported in the current version of the program, this is also reflected in the log window, and the directive itself is ignored.
Once the analysis is finished, you will be informed about the results via a dialog window that will offer you to either save the results and continue working with imported file (Finish button), or decline the imported file and revert to the state prior to importing (Cancel button). When you click on Finish, you'll be advised to check the Home Page Settings for the site, for which this file is being created, and modify them if needed. Then all information from the imported file will be transferred into your project, new spiders found in the file will be added to the list at spider list page, and all spiders from the file will be selected and added to the selected spiders list at the Disallow Tab.
If you are using a non-registered version, it will work in demo mode and you will only be able to work with standard spider list with no ability to add, delete, or edit entries. In this case when a new User-Agent that isn't on the standard spider list is found, you will receive a message stating that the program cannot add new User-Agent to the list while in demo mode.
<<< Project Functions
Home Page settings for the Imported File >>>
|
