Distributed crawler downtime
The server used to distribute urls for download are having disk problems. We are useing two SCSI disks in raid1 (mirroring), one of this disk have fallen out. It don’t appear to be physical broken, only fallen out of the raid. We will have to rebuild the raid and see if it will start to work again.
This is 140 GB disks sow this will take some time, probably 10-12 hours. The crawling will be down for this period.