Scoutjet web crawler
Posted on September 16, 2009 | Category: Crawl Engine, Informational, Networking, Security
It seems like there have been quite a few new web crawlers around my ip recently. Today, I noticed a crawl from Scoutjet.com. Apparently, they are a new Silicon Valley search engine that is founded by the creators of Topix and DMOZ. They crawl with ip’s of 64.13.160.* and 38.108.180.*.
Soutjet was polite to my server. No problems here. Post a comment if you have been crawled!
Similar Articles
- » Hosting 2 Domains with 1 Server
- » GoogleLabs Browser Size determines what users see without scrolling
- » Curl expands with IMAP, POP3, and SMTP support
- » MakeMKV rips DVDs and BlueRays with 2 clicks
- » Firefox 3 Bookmarks Management in Ubuntu Linux 9.04 Part II
Leave a Reply
QR Code Link
