IX Web Hosting Status » Server recreation

IIS411 Recreation – Completed

IX: Lucas Hughes — Wed, 10 Mar 2010 23:26:28 +0000

IIS411 had issues with the raid card in it. We have made a recreation server to get away from the problematic hardware. Currently 50% of the accounts on the machine have been recreated onto the new machine. After all accounts have been created we will start copying the content over. Once we have more information on when this process will be done, we will let you know.

Regards

Lucas Hughes

Systems Technician

Update @10:10am 3/11/2010

All accounts have been recreated onto the new server and now the data is being copied over. It is at 30% and the current ETA on this is 48 hours till all services are restored and the server is back to normal. During this time FTP will be down as well as some features in your control panel that deal with this server directly. ie webshell and changing setting for iis411. All other services should be running as normal.

Marcus Livers

Update @2:20pm 3/11/2010

45% of the content has now been copied and the new ETA is 40 hours.

Marcus Livers

UPDATE @ 7:56am EST 3/12/2010

Due to a network failure recreation was halted over the evening. The failure has been fixed and the recreation has resumed. The ETA is still 40 hours at this time.

Daniel Sines

Systems Technician

Update @8:50am 03/12/2010

The process is currently at 85% and the new ETA is 15 to 20 hours. As soon as we have more info or a different ETA on this process we will let you know.

Marcus Livers

Update @3:57pm 03/12/2010

The process is currently at 90% and the ETA is 15 hours.

Marcus Livers

Update@12:10am 03/13/2010

The process is currently at 95% and the ETA is 10 hours.

Lucas Hughes

UPDATE @ 8:07am EST 03/13/2010

97% of all accounts were copied. ETA is up to 7 hours.

Daniel Sines

UPDATE @ 10:51am EDT 03/14/2010

I must apologize, but the previous estimates were not accurate. The current ETA to the server being back online with content from backups is 10 hours. Once this step is completed we’ll update the content from the original server on a per-account basis.

Matthew Almond

UPDATE@7:20pm EDT 03/14/2010

The services for iis411 are back online. The content is still resyncing and is expected to take 24 to 48 hrs for content to be completely restored. You may place a ticket through the control panel to manually perform sync so your content can be available sooner.

David Stuard

UPDATE@5:00pm EDT 03/18/2010

All files in all accounts have been updated. If you have any questions or concerns, please submit a support ticket. Thank you.

Matthew Almond

iis507 maintainence

IX: Lucas Hughes — Fri, 30 Oct 2009 02:35:14 +0000

10:40 pm EDT

iis507 is going down to replace a bad hard drive in it’s raid array. The machine will be down for 15 to 30 minutes. I will update this post once the drive replacement has been completed.

Lucas

Update@11:00 pm EDT

iis507 is no back online. The bad drive has been replaced and the array is now rebuilding. There may be some slowness from the machine while the rebuild takes place.

Update@8:45 pm EDT 10-31-09

iis507 went offline for about 15 minutes so we could check the raid rebuild status for the machine. It is now back online.

Update@9:30 pm EDT

This machine is going offline again to check the raid. The raid is not wanting to rebuild with the new drives in the machine. ETA is 1 hour while we check to see what the issue is.

Update @10:30 pm EDT

iis507 is back online but is still having raid problems. We are going to recreate the server so that we don’t have the raid issues with the current machine.

Update@12:10 am EDT

The new server has been installed and our Windows Admins are starting on getting the machine ready for recreation. The recreation process can take up to 2 days to finish. Some services may be slow during this process. We will update you once we have more information about the recreation.

Update @11/3/09 2:50am EDT: The new server is now ready and we will be swapping servers and finishing up the final configuration of the new server. IIS507 will be offline for about 30 minutes while we do this. – Anthony

Update @11/3/09 3:20am EDT: We are still configuring the new server. The process is taking a little bit longer than expected. We expect to be completely finished no later than 30 minutes from now. – Anthony

Update @11/3/09 3:30am EDT: IIS507 is back online and now on the new server. The content there is from a backup that is about 2 weeks old. We are now syncing the data from the old server to the new server in order to get the most recent content. This sync process we expect to complete in the next 24 hours. – Anthony

Update @11/4/09 8:00am EDT: The data syncing is still in progress right now. We have about 90% of this complete. – Anthony

UPDATE @11/5/09 11:12AM: As of 5:49PM on 11/4/09 the data syncing is now finished. So everything should be back to normal with your sites. If you have any issues about content not showing up or not being there please contact us and we will take care of the issue immediately.

Marcus

IIS502 down

IX: Tiberiu Ungureanu — Mon, 21 Sep 2009 16:12:13 +0000

We have RAID issues on IIS502. One drive died in the raid5 configuration, and we noticed the card didn’t start recreation on the spare drive. We have replaced the RAID controller, and this didn’t help either. Then we replaced the spare drive with another drive, but still no luck.

We didn’t lose hope on existing IIS502 yet, but we have already started recreation of the server, as if it would be completely dead. It will take probably up to 48 hours to recreate IIS502 completely, and we hope we will be able to bring the old IIS502 back to life way before that. We expect no data loss, as we can still access the data from old IIS502. Just in case that fails, we have 5 days-old backups.

We will update you as soon as we gather more data.

Update @ 2:43am EST – We are currently in the IP recreation phase of this process. We will continue to update with new information as it comes. – Anthony

Update @ 9:20am EST – Content copy is in progress, ETA of ~20 hours.

Update @ 9/23/08 6:10am EST - IIS502 recreation has now completed. – Anthony

web504, web505, web506, web512, web515 Account Moves

IX: Matthew Almond — Tue, 08 Sep 2009 13:24:39 +0000

As per a notification email sent last week, we are moving a number of accounts from web504, web505, web506, web512 and web515 starting today. The process should be seamless for most customers. You will be notified by ticket after your account is moved. Domains using dedicated IPs will have their traffic forwarded for a period of three days to mitigate the DNS propagation delay. Customers with domains using shared IP should expect their sites to resume function after 24 hours. If you have questions regarding this procedure, please use the ticketing system. Thank you.

/Matthew

web502 Account Moves

IX: Matthew Almond — Wed, 02 Sep 2009 15:00:33 +0000

As per a notification email sent early last week, we’re moving all accounts off web502 starting today. The process should be seamless for most customers. You will be notified by ticket after your account is moved. Domains using dedicated IPs will have their traffic forwarded for a period of three days to mitigate the DNS propagation delay. Customers with domains using shared IP should expect their sites to resume function after 24 hours. If you have questions regarding this procedure, please use the ticketing system. Thank you.

/Matthew

UPDATE: The process is complete. We are still forwarding dedicated IP web traffic to the new server. If you experience any issues, please ensure you are using the following nameservers on your domain:

ns15.ixwebhosting.com
ns16.ixwebhosting.com

All affected customers have been contacted via our helpdesk system. If you do have any unresolved problems, please re-open the associated ticket. Thank you.

IIS 312

Amanda — Thu, 13 Aug 2009 15:04:30 +0000

At the current moment, iis312 is being recreated because of raid issues. Your sites should be up and working but we have had to take preventive measures to ensure a good copy of your site goes to the new server.

FTP access has been turned off
HSPHERE access has been turned off

These services will be restored as soon as the new server is up and running. The current ETA is 46 hours.

I will keep you posted!

Amanda