The database of Editor and Analyzer has more than 150 spiders and it is regularly updated. This data is used in both the standard exclusion file editor for spider management and the log analyzer for spider detection. You can easily edit existing spiders and add new crawlers to your own database on the Spiders List tab. If you know a popular spider and would like to see it in the next database update, please let us know.  View the list of spiders ordered by primary language
|