Update spiders.txt#289

Open

acidvertigo wants to merge 27 commits intoosCommerce:masterfrom

acidvertigo:patch-22

Commits on Dec 9, 2014

Update spiders.txt
acidvertigo
committed
change 008 spider to voltron
acidvertigo
committed
Remove AnyApexBot as not exists anymore
acidvertigo
committed
Remove B-l-i-t-z-B-O-T as does not exists anymore
acidvertigo
committed
Remove BillyBobBot as does not exists anymore
acidvertigo
committed
remoe Boithobot as does not works anymore
acidvertigo
committed
Remove btbot as use google search results
acidvertigo
committed
remove CatchBot as does not exists anymore
acidvertigo
committed
Remove Cerberian Drtrs as it is a filtering tool
acidvertigo
committed
Remove Charlotte as it use yahoo search results
acidvertigo
committed
Remove ConveraCrawler cosmos spiders as index not html pages
acidvertigo
committed
Remove Covario IDS as does not seems to work anymore
acidvertigo
committed
Remove DiamondBot as seems to not exists anymore
acidvertigo
committed
Remove discobot as does not exists anymore
acidvertigo
committed
Remove EARTHCOM.info as does not exists anymore
acidvertigo
committed
Remove EmeraldShield.com WebBot as does not exists anymore
acidvertigo
committed
remove EsperanzaBot as does not exists anymore
acidvertigo
committed
Remove FDSE robot as is an internal serch engine for sites
acidvertigo
committed
Remove FindLinks as actually is not working
acidvertigo
committed
Remove g2crawler as it is not used anymore
acidvertigo
committed
remove Gaisbot as does not exists anymore
acidvertigo
committed
Remove genieBot as does not exists anymore
acidvertigo
committed
Remove GurujiBot as does not exists anymore
acidvertigo
committed
remove HappyFunBot as does not exists anymore
acidvertigo
committed
Remove small and not existent spiders user agents
acidvertigo
committed
Convert all to lowercase
acidvertigo
committed
Fix typo
acidvertigo
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update spiders.txt#289

Update spiders.txt#289
acidvertigo wants to merge 27 commits intoosCommerce:masterfrom
acidvertigo:patch-22

Commits on Dec 9, 2014

Update spiders.txt

change 008 spider to voltron

Remove AnyApexBot as not exists anymore

Remove B-l-i-t-z-B-O-T as does not exists anymore

Remove BillyBobBot as does not exists anymore

remoe Boithobot as does not works anymore

Remove btbot as use google search results

remove CatchBot as does not exists anymore

Remove Cerberian Drtrs as it is a filtering tool

Remove Charlotte as it use yahoo search results

Remove ConveraCrawler cosmos spiders as index not html pages

Remove Covario IDS as does not seems to work anymore

Remove DiamondBot as seems to not exists anymore

Remove discobot as does not exists anymore

Remove EARTHCOM.info as does not exists anymore

Remove EmeraldShield.com WebBot as does not exists anymore

remove EsperanzaBot as does not exists anymore

Remove FDSE robot as is an internal serch engine for sites

Remove FindLinks as actually is not working

Remove g2crawler as it is not used anymore

remove Gaisbot as does not exists anymore

Remove genieBot as does not exists anymore

Remove GurujiBot as does not exists anymore

remove HappyFunBot as does not exists anymore

Remove small and not existent spiders user agents

Convert all to lowercase

Fix typo