offlinetime while rebuilding db

we switched the domain-database to new, hopefully faster hdd's sponsored by roelof temmingh (and me).
since postgresql still denies a parallel installation i took the opportunity to rebuild the database, update the server and switch the stuff to the new sata-raid. it'll take a few hours until the database is rebuilt and restarted, but it's weekend - you don't work anyway, do you?

we'll be back again soon.

tom

facts and figures

our current lookup-lag: 237.405 days.
current number of known domains: 39.163.435

still sorting in ~100.000 domains per day from queues, mainly generic .com-domains.

tom

facts and figures

For the historic records:
we still lag with re-lookups of our hostnames - current time between a renewal of the IP-Lookup for a hostname is 238,749 days.

We know 36.314.321 domains, the queue with hostnames to sort in decreased to 71.000.000.
The "offline-queue" with not yet queued hostnames is around 5 million hosts.

We're still on an SCSI-Array straight out of the hardware-museum with 8 hdds, 31 of 141 GB free. Over ten year old hardware, still working fine and reasonably fast.

tom

Cuill

Cuill started crawling Serverniff a few days ago. It does crawl slow, but very steady.

I don't know if this is good news for serversniff, but they have a friendly and steady crawler.
I wonder, when and if they go public - and i'd bet whatever you hold against me that they will be bought by a major company (there are not too many of them left) maximum 6 months after they open their search to the general public.

Anybody willing to bet against?

If you don't know cuill - google and teccrunch will tell more.

tom