Incident Description:
Our system administrators detected an issue with web261. The server had to be restarted and is now doing a mandatory filesystem check (FSCK). During this time the web server will be unavailable, meaning that websites hosted on the server will be unavailable as well.
Incident Updates
- 03:23AM EST - Our optimistic ETA is set to 2 hours from this time. FSCK is still running.
- 04:48AM EST - Normal FSCK has failed. We are re-running a forced FSCK. It is currently at .2% completion.
- 06:02AM EST - FSCK is currently at 38%
- 08:12AM EST - FSCK is currently at 73%, but we're seeing additional issues that will need to be addressed. We'll update our progress at 1pm EST.
- 13:37PM EST - FSCK is complete, but we found some significant HD issues and need to rebuild drives. No ETA but will update at 5pm EST.
- 22:35PM EST - The last drive for the rebuild is at 50%. Next update in 5 hours.
- 03/06/12:
02:49AM EST - The rebuild is currently at 88%.
- 06:45AM EST - The raid rebuild is finished.
Resolution Description
Web261 is now back to normal. If you have any additional issues please contact us via LiveChat, Phone or our Helpdesk ticket system.