Announcements:
[Closed] Data Center Fire - Intervals servers not impacted, but residual network issues

1. •  
     CommentAuthorMichael
   • CommentTimeJun 2nd 2008 edited

    
   This weekend the data center that hosts Intervals had an electric fire. Intervals servers were not impacted, but since the data center was impacted heavily we are experiencing residuals problems. The main issue is that emails sent from Intervals are taking a while to send. Within the Intervals interface, anything that sends an email is presently lagging. We are actively working to try and eliminate the lag and we are monitoring the data center situation.
   
   service-update.theplanet.com is providing updates on the fire and recovery effort if you would like to follow the situation.
   

   This evening (Saturday, May 31st) at 4:55pm CDT in our H1 data center, electrical gear shorted, creating an explosion and fire that knocked down three walls surrounding our electrical equipment room. Thankfully, no one was injured. In addition, no customer servers were damaged or lost. Early indications are that the short was in a high-volume wire conduit.

2. •  
     CommentAuthorMichael
   • CommentTimeJun 2nd 2008

    
   ## Update ##
   
   We just received notice from the data center that much of what went offline is back online. We are currently testing Intervals and much of the slowness appears to be resolved. We will continue to monitor the situation and keep it our main priority until it is fully resolved.
3. •  
     CommentAuthorMichael
   • CommentTimeJun 3rd 2008 edited

    
   Another day has passed and today we did not receive any support requests regarding email hangs or heavy slowness and all of our monitoring services and probes look good. If you are experiencing any oddities, please click on the "Find a bug?" link in the footer of your account and we will investigate right away.
4. •  
     CommentAuthorMichael
   • CommentTimeJun 4th 2008

    
   Today we are experiencing some additional sluggishness. We are troubleshooting and investigating right now.
5. •  
     CommentAuthorMichael
   • CommentTimeJun 4th 2008

    
   We just launched a modification to how email is handled that should significantly speed up the sluggishness that occurs on any page where an email is sent (new task, email this page, etc.). Our initial testing looks positive.