Current Time: 15:26:04 EST
 

mail1102 and mail302 servers also blocked by SpamCannibal

Posted In: Outage — Jan 29th, 2012 at 10:29 am EST by IX: Mike C.

Incident Description:

Through further research, we’ve found two additional mail servers that have been blocked by SpamCannibal: mail1102 and mail302. We’re working with SpamCannibal to resolve as soon as possible, but have not yet been able to remove from their blacklist.

Which Customers are Impacted?

All clients on mail1102 and mail302

How are Customers Impacted?

Clients on mail1102 and mail302 will not be able to send mail to contacts who use SpamCannibal as a DNSBL service.

How often will we be updated?

n/a

Time to Resolution (ETA)

n/a

Incident Updates

n/a

Resolution Description

n/a

Web601 – Shared IP Maintenance – Resolved

Posted In: Maintenance — Jan 26th, 2012 at 11:42 pm EST by IX: Danny

Incident Description:

We’ve applied a 4 hour block to IP: 173.83.53.2 due to irregular incoming traffic. Only customers using this IP address for this domain will be affected.

Which Customers are Impacted?

Customers who have websites on shared IP: 173.83.53.2

How are Customers Impacted?

Site on the above-mentioned shared IP will be inaccessible

How often will we be updated?

Every 4 hours

Time to Resolution (ETA)

4 hours

Incident Updates

N/A

Resolution Description

IP address 173.83.53.2 is no longer blocked.

Mail508 blocked by blacklist company SpamCannibal

Posted In: Security Issues — Tags: — Jan 26th, 2012 at 1:44 pm EST by john

Incident Description:

Any user that uses the spam filter SpamCannibal will not be able to receive mail via mail508 servers. We currently have not been able to resolve this issue with SpamCannibal.

Which Customers are Impacted?

All user currently on mail508

How are Customers Impacted?

Customers on mail508 will not be able to receive email from recipients that's mail goes through SpamCannibal spam filter.

How often will we be updated?

n/a

Time to Resolution (ETA)

n/a

Incident Updates

n/a

Resolution Description

n/a

Web1116 – Shared IP Maintenance

Posted In: Maintenance — Jan 24th, 2012 at 8:00 am EST by IX: Mike C.

Incident Description:

We’ve applied a 4 hour block to IP: 72.41.86.2 due to irregular incoming traffic. Only customers using this IP address for this domain will be affected.

Which Customers are Impacted?

Customers who have websites on shared IP: 72.41.86.2

How are Customers Impacted?

Site on the above-mentioned shared IP will be inaccessible

How often will we be updated?

every 4 hours

Time to Resolution (ETA)

4 hours

Incident Updates

  • 12:22 pm - Adding an additional 4 hour block since the irregular incoming traffic has yet to decrease.

Resolution Description

n/a

web1117 – Maintenance – Resolved

Posted In: Maintenance — Jan 13th, 2012 at 6:54 am EST by IX: Bobby

Incident Description:

Our system administrators detected an issue with web1117 The server had to be restarted and is now doing a mandatory filesystem check (FSCK). During this time the web server will be unavailable, meaning that websites hosted on the server will be unavailable as well.

Which Customers are Impacted?

Customers with content on web1117

How are Customers Impacted?

All websites/FTP/control panel are not reachable now

How often will we be updated?

2 hours

Time to Resolution (ETA)

2 hours

Incident Updates

  • 06:30AM EST- FSCK has begun
  • 8:51 AM EST - FSCK still in progress. Will update a percentage when available.
  • 9:43 AM EST - FSCK Complete, Server up and running.

Resolution Description

FSCK has completed and server responding normally.

New/Moved Domain Mail Issue – All CPs – Resolved

Posted In: Outage — Jan 12th, 2012 at 12:09 pm EST by IX: Mike N.

Incident Description:

We are currently experiencing an error in which a script that configures the correct CNAME records is running slowly. Our system admins are currently working on fixing this issue.

Which Customers are Impacted?

All customers adding or moving domains, any customers that have been recently migrated to CP13

How are Customers Impacted?

Email will continue to come in (IE, will not bounce), but the ability to send/receive may only work intermittently.

How often will we be updated?

Every hour

Time to Resolution (ETA)

N/A

Incident Updates

N/A

Resolution Description

Script has executed and completed fixing the issue

iis1009 – Maintenance – Resolved

Posted In: Maintenance — Jan 12th, 2012 at 4:27 am EST by IX: Bobby

Incident Description:

Our system administrators detected an issue with iis1009. The server had to be restarted and is now doing a mandatory filesystem check (FSCK). During this time the web server will be unavailable, meaning that websites hosted on the server will be unavailable as well.

Which Customers are Impacted?

Customers with content on iis1009.

How are Customers Impacted?

All websites/FTP/control panel are not reachable now

How often will we be updated?

2 hours

Time to Resolution (ETA)

2 hours

Incident Updates

  • 04:00AM EST -  FSCK is currently in Stages 2 of 3
  • 06:00AM EST - FSCK has completed

Resolution Description

Server is back online

iis307 FTP unavailable – Resolved

Posted In: Maintenance — Jan 05th, 2012 at 11:06 am EST by IX: Robert Harrington

Incident Description:

Windows Server iis307 is currently under recreation due to a failed raid drive.  During this time websites should still be up, but FTP may be unavailable.  We are expecting this recreation to take 1 – 2 days.

Which Customers are Impacted?

Customers who have sites hosted on iis307.

How are Customers Impacted?

Customers may not be able to access the server using FTP.

How often will we be updated?

Every 4-12 hours.

Time to Resolution (ETA)

1 - 2 days.

Incident Updates

  • 3:00 PM EDT: We are in the process of copying content.  Current progress is:  37  of 144
  • 1:31 AM EDT: Current progress is:  58  of 144
  • 8:11 AM EDT: Current progress is: 69 of 144
  • 1:00 PM EDT: Current progress is: 78 of 144
  • 6:52 PM EDT: Current progress is: 80 of 144
  • 4:15 AM EDT: Current progress is: 82 of 144
  • 1:29 PM EDT: Current progress is: 96 of 144
  • 4:17 PM EDT: Current progress is: 102 of 144 accounts transferred
  • 9:15 PM EDT: Current progress is: 107 of 144 accounts transferred
  • 1/8/2012 7:25 AM EDT: Current progress is 112 of 144 accounts transferred
  • 1/8/2012 2:30 PM EDT: Current progress is 123 of 144 accounts transferred
  • 1/9/2012 3:30 AM EDT: Current progress is 124 of 144 accounts transferred
  • 1/9/2012 8:15 AM EDT:  Current progress is 129 of 144 accounts transferred
  • 1/9/2012 10:00 PM EDT: Current progress is 143 of 144 accounts transferred
  • 1/10/2012 7:20 AM EDT: Copy is still in progress. 143 of 144 accounts transferred
  • 1/10/2012 12:30 PM EDT: Content Sync is still in progress. 143 of 144 accounts transferred
  • 1/10/2012 11:30 PM EDT: Sync progress for the most part is finished. Our System Administrators are applying additional checks and other small fixes. Please standby for more updates.
  • 1/11/2012 7:15 AM EDT: Account Sync is complete and we're now working to port over all folder/file permissions. We'll keep you posted as we have more information.
  • 1/11/2012 1:20 PM EDT: The server is nearly finished. Updates are being applied as we speak, and then that's it!
  • 1/11/2012 10:01 PM EDT: We are bringing the new server online. Websites may go unavailable for a short period of time during this transition.
  • 1/11/2012 11:00 PM EDT: New server is online. All issues with this server should be fully resolved now.

Resolution Description

N/A.

iis413 – Maintenance – Resolved

Posted In: Maintenance — Jan 04th, 2012 at 1:26 am EST by IX: Danny

Incident Description:

iis413 has been having some technical issues. We’re currently running a File System Check and anticipate the server will be up shortly.

Which Customers are Impacted?

Customers on iis413

How are Customers Impacted?

All websites/FTP/Control Panel are not reachable now.

How often will we be updated?

1-2 hours

Time to Resolution (ETA)

1-2 hours

Incident Updates

  • 01:10AM EST - Checking file system . Stage 1 of 3.
  • 02:17AM EST - CHKDSK is verifying indexes (stage 2 of 3)
  • 04:05AM EST - All finished. Services should be back up and running.

Resolution Description

All finished. Services should be back up and running.

Mail56 – Maintenance – Completed

Posted In: Maintenance — Jan 03rd, 2012 at 10:33 am EST by IX: Mike C.

Incident Description:

Mail56 has been having issues staying online this morning. We’re currently running a File Scan Check and anticipate the server will be up shortly.

Which Customers are Impacted?

Customers using mail on mail56

How are Customers Impacted?

mail will be inaccessible as we run our FSCK

How often will we be updated?

Hourly

Time to Resolution (ETA)

30 mins to an hour

Incident Updates

  • 10:37 FSCK at 45%
  • 11:13 FSCK complete and mail server responding

Resolution Description

FSCK repaired issues, mail server now responding normally

Belated holiday party for our live chat and ticket support teams – completed

Posted In: Other Issues — Dec 27th, 2011 at 9:38 am EST by IX: Mike C.

Incident Description:

Our Live Chat and ticket support teams have been working hard throughout the Christmas season and we’re giving them a belated holiday party today. Expect Live chat and ticket response time to be a little slower from 2 -7 pm EST today. Thanks for your understanding throughout this 5 hour period and enjoy the rest of your holiday!

Which Customers are Impacted?

All customers needing ticket and live chat support

How are Customers Impacted?

Ticket and Live chat response will be slower from 2 - 7pm EST

How often will we be updated?

n/a

Time to Resolution (ETA)

7pm EST

Incident Updates

n/a

Resolution Description

At this time our LiveChat and ticket support teams are back at full capacity.

Global Mail Maintenance – Resolved

Posted In: Maintenance — Dec 26th, 2011 at 3:32 am EST by IX: Danny

Incident Description:

There will be a brief global mail maintenance starting at 3:00AM EST. It is expected to be over within 2-4 hours. There may be some delays in receiving mail. We will be updating as more information comes along.

Which Customers are Impacted?

All customers with mail services.

How are Customers Impacted?

It will affect mail delivery for all customers. There may be mail delivery delays.

How often will we be updated?

4 hours.

Time to Resolution (ETA)

2-4 hours.

Incident Updates

  • 03:09AM EST - Mail maintenance has begun.
  • 06:05AM EST - Maintenance has been completed

Resolution Description

Servers are back online

web1419 Shared IP – Down – Resolved

Posted In: Outage — Dec 23rd, 2011 at 12:17 am EST by IX: Bobby

Incident Description:

The shared IP on our web1419 server has been blocked due to a DDoS (Distributed Denial of Service) attack.

To check your IP address:

  • Login to your account and click manage on your control panel.
  • Click the domains icon.
  • If a shared IP address is utilized, it will be displayed in the list.

Which Customers are Impacted?

Customers utilizing the Shared IP address on the web1419 server.

How are Customers Impacted?

Websites utilizing the shared IP address on the web1419 server will be temporarily unavailable.

How often will we be updated?

Every 6 hours

Time to Resolution (ETA)

N/A

Incident Updates

  • 12:07 AM EST - Filter is set to expire at 6:07AM EST. If DDoS attack is persistent, a longer filter will be put in place
  • 06:15 AM EST - Filter expired. No further issues reported.

Resolution Description

DDoS attack has been filtered by temporarily blocking the associated shared IP address.

Phone Support Holiday Party Dec. 22nd 1:00PM – 3:00PM EST – FINISHED

Posted In: Other Issues — Dec 22nd, 2011 at 11:30 am EST by IX: Trevor Lowe

Incident Description:

Our phone support Customer Relations team will be unavailable from 1:00PM – 3:00PM EST. We will be available for ticket and chat support during this time. We sincerely apologize for any inconveniences that this causes to our customers. Thank you all for your patience and understanding.

Which Customers are Impacted?

Phone Support will be unavailable for all customers.

How are Customers Impacted?

Phones will not be operational during this time.

How often will we be updated?

none

Time to Resolution (ETA)

2 hours: 1:00PM - 3:00PM EST

Incident Updates

None

Resolution Description

None

web413 – Down – Resolved

Posted In: Outage — Dec 22nd, 2011 at 5:41 am EST by IX: Danny

Incident Description:

We experienced some abnormal performance from this server earlier today and have begun to run a file scan check. We will keep status blogs updated as we learn more.

Which Customers are Impacted?

All customers on web413.

How are Customers Impacted?

Websites on web413 will be down until resolution.

How often will we be updated?

Every 2 hours.

Time to Resolution (ETA)

1-2 hours.

Incident Updates

  • 5:41AM EST - Server started a FSCK.
  • 6:50AM EST - FSCK is currently at 41%. 1 -2 hours until completion.
  • 8:25AM EST - FSCK Complete, server brought back online

Resolution Description

Filescan check has completed and web413 has been brought back online.

 
© 2011 IX Web Hosting.