Current Time: 15:26:04 EST
 

MCP Maintenance – Monday, July 25, 2016 4:00 AM EDT – RESOLVED

Posted In: Maintenance — Jul 22nd, 2016 at 7:00 am EDT by IX: Greg Cook

Incident Description:

Our administrators will perform maintenance on our Management Control Panel from 4AM to 5AM EDT. During this maintenance period the Management Control Panel will be unavailable.  All user servers, websites, and email are unaffected by this maintenance and will operate normally.

 

 

 

Which Customers are Impacted?

All customers attempting to login to their Management Control Panel

How are Customers Impacted?

The Management Control Panel will be unavailable during maintenance.

How often will we be updated?

Upon resolution

Time to Resolution (ETA)

1 hour

Incident Updates

Update: Maintenance has begun. Maintenance began at 4:10am  EDT Monday, July 25, 2016.

Resolution Description

Maintenance finished completely and successfully at 4:45am  EDT Monday, July 25, 2016.

MySql1305 Connection Issues – Resolved

Posted In: Outage — Jul 24th, 2016 at 3:50 pm EDT by IX: Greg Cook
Shared services are affected

Incident Description:

The MySql1305 server appears to be in read-only mode.  To correct this issue the server will need to be rebooted.  This is expected to take 30 – 40 minutes to complete.

Which Customers are Impacted?

All clients using this server.

How are Customers Impacted?

All websites will not be reachable.

How often will we be updated?

As Needed

Time to Resolution (ETA)

30-40 minutes

Incident Updates

n/a

Resolution Description

Server is back online.

Mysql1305 Down – Resolved

Posted In: Outage — Jul 23rd, 2016 at 9:52 am EDT by IX: Victoria Witten
Shared services are affected

Incident Description:

The Mysql1305 server appears to be in read-only mode.  To correct this issue the server will need to be rebooted and FSCK ran on the root file system.  This is expected to take 30 minutes to complete.

Web946 – Server Maintenance – FSCK – Resolved

Posted In: Maintenance — Jul 23rd, 2016 at 1:58 am EDT by IX: Kristopher G.
Shared services are affected

Incident Description:

Our system administrators are performing a File System Check on Web946. The server is being restarted and is now doing a mandatory file system check (FSCK). During this time the web server will be unavailable, meaning that websites hosted on the server will not be working.

Which Customers are Impacted?

All clients using this web server.

How are Customers Impacted?

All websites/FTP/control panel will not be reachable.

How often will we be updated?

3 hours

Time to Resolution (ETA)

6 hours

Incident Updates

  • 2016/07/23 04:10 AM ET - FSCK is at 24.2%. We are extending the maintenance window +2 hours from original maintenance window to allow for FSCK to complete.
  • 2016/07/23 07:20 AM EDT- FSCK appears to still be in process.  We are extending the maintenance window an additional +2 hours from original maintenance window to allow for FSCK to complete.
  • 2016/07/23 09:00 AM EDT -  We are extending the maintenance window an additional +1 hours from original maintenance window to allow for FSCK to complete.
  • 2016/07/23 10:00 AM EDT- FSCK has been completed.

Resolution Description

FSCK has been completed and the server is up.

mail1303 – File System Check(FSCK) – Resolved

Posted In: Outage — Jul 21st, 2016 at 8:51 pm EDT by IX: Greg Cook
Shared services are affected

Incident Description:

Mail1303 has fallen into Read Only mode and requires a reboot. A file system check is being performed. No data loss is to be expected during this time.

Which Customers are Impacted?

All customers on Mail1303

How are Customers Impacted?

Services may be slow or inaccessible

How often will we be updated?

As available

Time to Resolution (ETA)

4 hours

Incident Updates

n/a

Resolution Description

FSCK has completed and the server is back up.

mail1309 – File System Check(FSCK)-RESOLVED

Posted In: Outage — Jul 16th, 2016 at 9:18 am EDT by IX: Victoria Witten
Shared services are affected

Incident Description:

Mail1309 has fallen in to Read Only mode and requires a reboot. A file system check is being performed. No data loss is to be expected during this time.

Which Customers are Impacted?

All customers Mail1309

How are Customers Impacted?

Services may be slow or inaccessible

How often will we be updated?

As available

Time to Resolution (ETA)

4 hours

Incident Updates

n/a

Resolution Description

The FSCK process is complete and the server has fully rebooted. Mail services on Mail1309 have been fully restored.

Mail1302 – File System Check(FSCK) – Resolved

Posted In: Outage — Jul 16th, 2016 at 12:32 am EDT by IX: Kristopher G.
Shared services are affected

Incident Description:

Mail1302 has fallen in to Read Only mode and requires a reboot. A file system check is being performed. No data loss is to be expected during this time.

Which Customers are Impacted?

All customers Mail1302

How are Customers Impacted?

Services may be slow or inaccessible

How often will we be updated?

4 hours

Time to Resolution (ETA)

4 hours

Incident Updates

N/A

Resolution Description

File System Check has completed and services have been resumed back to normal. Thank you for your patience

Urgent Server Maintenance – RESOLVED

Posted In: Outage — Jul 13th, 2016 at 4:01 am EDT by IX: Kristopher G.
Shared services are affected

Incident Description:

We are currently working to resolve an issue experienced earlier where some web and mail servers had a brief loss of communication to the storage drives. As a fail safe to protect data, some servers went in to Read Only mode and any dynamic site became unavailable, however static sites will still  operate. Connection was quickly restored, but servers must be restarted to restore normal operations.

Please see below list of affected servers.

List of affected servers:
web1002, web1003, web1007, web1010, web1014, web1020, web1022, web1029, web1130, web1115, web303, web313, web407, web421, web905, web907, web908, web909, web913, web916, web919, web921, web923, web925, web929, web942, web943, web944, mail515, mail519, mail911,  mail907, web1018, web927

Which Customers are Impacted?

All customers on mentioned servers in description above

How are Customers Impacted?

Services for mentioned servers above may be unavailable.

How often will we be updated?

As new information is provided.

Time to Resolution (ETA)

Servers will come up as they are rebooted, but it could take up to 4 hours for all servers to be back online.

Incident Updates

  • 2016/07/13 04:46 AM ET - Mail515 is up
  • 2016/07/13 04:49 AM ET - Web1003 is up
  • 2016/07/13 04:52 AM ET - Web1007 is up
  • 2016/07/13 05:25 AM ET - Web407 is up.
  • 2016/07/13 06:38 AM ET - Web1010 and Web1018 are up
  • 2016/07/13 06:50 AM ET - Web1115 is up.
  • 2016/07/13 07:19 AM ET -    Web1014 and Web1020 are up.
  • 2016/07/13 07:23 AM ET - Web909 is up.
  • 2016/07/13 07:26 AM ET - Web1130 and Web908 are up.
  • 2016/07/13 07:32 AM ET -Web905 is up.
  • 2016/07/13 07:40 AM ET - Web313 is up.
  • 2016/07/13 07:46 AM ET - Web1130, Web944 and Web907 are up.
  • 2016/07/13  07:52 AM ET - Web916 and Web913 are up.
  • 2016/07/13 08:13 AM ET - Web921,Web1022 and Mail519 are up.
  • 2016/07/13 08:25 AM ET - Web925 is up.
  • 2016/07/13 08:31 AM ET -Web923 is up.
  • 2016/07/13 08:35 AM ET -Mail907 is up.
  • 2016/07/13 08:45 AM ET- Web303 is up.
  • 2016/07/13 08:59 AM ET -  All servers have been rebooted. However, Web1002,Web421,Web 927 and Mail911 remain under fsck. Fsck stands for “file system check” and is a tool for checking the consistency of a file system. Generally, fsck is run automatically when the server is booted and the operating system detects if the file system is in an inconsistent state. It corrects errors and makes sure that all data is safe and secure. There is no progress indicator while FSCK is running but the servers will be up as soon as this process is finished.
  • 2016/07/13 09:07 AM ET- Web927 and Web421 are up.
  • 2016/07/13 09:47 AM ET -Web919 - was up at 8:10 AM,Web943 was up at 8:50 AM,Web1029, Web929 and Web942 are up.
  • 2016/07/13 10:00 AM ET - Mail911 is up.
  • 2016/07/13 10:03 Am Et - Web1002 is up.

Resolution Description

All servers are up  and functioning  as of 2106/07/13 at 10:04 AM ET ,  urgent maintenance is finished.  Thank you for your patience.

IIS1302 Server is Down – Resolved

Posted In: Outage — Jul 06th, 2016 at 9:09 pm EDT by IX: Daren H.
Shared services are affected

Incident Description:

We are currently experiencing issues with IIS1302. The server had to be rebooted and one of the disk’s got stuck upon reboot.  We are investigating the issue and working to bring it back up as soon as possible. We will update this post once we have more information regarding the affected server and once we find resolution

Which Customers are Impacted?

All customer on affected server.

How are Customers Impacted?

Services unavailable.

How often will we be updated?

N/A

Time to Resolution (ETA)

N/A

Incident Updates

N/A

Resolution Description

Resolved  Server has been rebooted. The disk has been released. All services are back to normal.

web1103 shared IP: 50.6.0.2 – Filtered – Resolved

Posted In: Security Issues — Jul 02nd, 2016 at 6:51 am EDT by IX: Kristopher G.
Shared services are affected

Incident Description:

Our system administrators detected a Distributed Denial of Service attack (DDoS), launched against the shared IP address of Web1103 – 50.6.0.2

A DDoS is is an attempt to make a computer resource unavailable to its intended users. The way the attack is carried out varies as much as who is attacked and why. One common method of attack involves saturating the target (victim) machine with external communications requests. This creates so many false connections to the server, real attempts to connect cannot be completed. Because so many domains share an IP, it is not possible to determine which site the attack is directed at. In many cases, a temporary block is sufficient until the DOS attack passes, however, if the attack continues, the shared IP could remain blocked for an extended period of time.

In order to mitigate the attack and keep server online, system administrators have temporarily filtered all connections to that IP address. This allows us to keep websites that are hosted on the dedicated IP addresses of Web1103 online. Once the attack is over, we will remove the IP filter

Which Customers are Impacted?

All customers with websites that use web1103’s shared IP. To check your IP, please click manage next to your hosting account, next click the Domains icon to see your list of domains and their assigned IP. If you need assistance, please contact support.

How are Customers Impacted?

All websites using the shared IP address of Web1103 are unavailable while the attack is being filtered.

How often will we be updated?

Once current filter has expired.

Time to Resolution (ETA)

Once current filter has expired.

Incident Updates

  • 2016/07/02 22:03 PM EST - Filter has been re-initiated for 8 hours.

Resolution Description

The filter has been removed and services resumed back to normal. Thank you.

IIS Server Urgent Maintenance – Resolved

Posted In: Outage — Jun 17th, 2016 at 12:58 am EDT by IX: Kristopher G.
Shared services are affected

Incident Description:

We are currently experiencing issues with multiple IIS servers. We are investigating the issue and working to bring them back up as soon as possible. We will update this post once we have more information regarding affected servers and resolution.

Which Customers are Impacted?

Once further information is gathered

How are Customers Impacted?

Services and websites may appear to be unreachable

How often will we be updated?

Once further information is gathered

Time to Resolution (ETA)

n/a

Incident Updates

n/a

Resolution Description

All services should now be back to their normal working state

DDoS (Distributed Denial of Service) attack. Resolved.

Posted In: Security Issues — Jun 13th, 2016 at 8:38 am EDT by IX: Toi Santamaria
Cloud services are affected
Shared services are affected
my.ixwebhosting.com affected

Incident Description:

We are currently experiencing a DDoS (Distributed Denial of Service) attack against our services. Our system administration team is working to identify the source IPs and block this attack.

 

When accessing  your  my.ixwebhosting.com accounts you  may  experience slowness.

We will update this status blog post as we get additional information from our systems administrators.

Which Customers are Impacted?

Anyone visiting their my.ixwebhosting.com account may temporarily experience slowness.

How are Customers Impacted?

Slowness using my.ixwebhosting.com accounts.

How often will we be updated?

30 minutes.

Time to Resolution (ETA)

N/A

Incident Updates

N/A

Resolution Description

We no longer observe slowness on our services.

CP3 Server maintenance – Resolved

Posted In: Maintenance — Jun 12th, 2016 at 1:57 pm EDT by IX: Toi Santamaria
Shared services are affected

Incident Description:

Our administrators are performing maintenance on CP3 server  to fix R/O of  the root partition.

Which Customers are Impacted?

All customers on CP3 server.

How are Customers Impacted?

Services affected - Control panel  access and Webmail

How often will we be updated?

N/A

Time to Resolution (ETA)

110 minutes.

Incident Updates

  • 2016-06-12 2:26 PM EST - CP3  server under FSCK
  • 2016-06-12 3:36 PM EST - ETA is expected in another 20 minutes

Resolution Description

FSCK is completed and services restored.

iis319 server is down.Resolved.

Posted In: Outage — Jun 12th, 2016 at 10:22 am EDT by IX: Toi Santamaria
Shared services are affected

Incident Description:

Our administrators have found an  issue causing iis319 to be intermittently down.   The administrators are currently investigating .

Which Customers are Impacted?

All customer on affected server.

How are Customers Impacted?

Services unavailable.

How often will we be updated?

N/A

Time to Resolution (ETA)

10 minutes.

Incident Updates

N/A

Resolution Description

iis319 server  is up and  all services are available.

Control Panel Maintenance – Complete

Posted In: Maintenance — Jun 09th, 2016 at 2:33 am EDT by IX: Admin
Cloud services are affected
VPS services are affected
Shared services are affected
my.ixwebhosting.com affected

Incident Description:

At 3:00 AM EDT on June 9th, 2016 we will be performing maintenance on our Manage Control Panel.  We expect this maintenance to last for 30 minutes and during this time access to the control panel will be unavailable.  This means that your websites, email, and databases will all be online, but access to edit your products and billing information will be unavailable.

Which Customers are Impacted?

All customers will be affected

How are Customers Impacted?

Customers will be unable to access their control panel to make edits to their account.  Email, websites, and databases will all be online

How often will we be updated?

We will update at the completion of the maintenance

Time to Resolution (ETA)

30 minutes

Incident Updates

N/A

Resolution Description

Maintenance has been completed and services resumed.

 
© 2011 IX Web Hosting.