We’re currently experiencing an issue with one of our Cloud Servers causing it to go offline. We’re working with Rackspace to get it back up as soon as possible. We’ll update this post when we know more or things are resolved. If you have any questions, please feel free to email help@zippykid.com.

UPDATE 4:35pm CST: The server has recovered from the issue and is now responding normally. There was an issue that caused the reboot signal to the box to fail, which took things down, but didn’t bring them back up. Things are running and should be stable, but we’re continuing to monitor.

We’re seeing similar database connection errors this morning across our systems. We’re working with Rackspace to determine the cause of the issue and resolve it ASAP. If you have any additional questions, please don’t hesitate to email help@zippykid.com and we’ll take a look.

UPDATE 6:30AM CDT: Rackspace is repairing a sync issue between the database servers. This is causing the current connection issues for sites. We don’t have an ETA for how long this should last, but we’ll update you when we know more.

UPDATE 6:45AM CDT: We’re expecting things to be more stable now and for sites to be responding. If you’re still expericing issues, please let us know.

As of Friday July 13th 2012 00:30 hours: It looks like things are back up and running. We’re looking to find out what happened, and how to avoid it. 

We’re experiencing database connectivity issues across the board. We’re working with Rackspace to solve this problem as we speak. Sorry for the down time. We’re aware of the issue and will fix this as soon as we can. 

Update as of Friday July 13th 2012: It looks like things are back up and running. We’re looking to find out what happened, and how to avoid it. 

There’s currently an issue with one of the host machines for our cloud servers. This is impacting a single server and things are offline for the time being. We’re working with Rackspace to determine the cause and provide an ETA to resolution. We’ll update you when we know more and sorry for the inconvience. If you have any questions, please don’t hesitate to email help@zippykid.com.

UPDATE 11:10 PM CDT: The issues with the host machine appear to have been resolved and the cloud server is coming back online. We’re still waiting on confirmation from RackSpace, but services look to be resuming. If you’re noticing any issues with your site, please don’t hesitate to email help@zippykid.com and we’ll be glad to take a look.

All of ZippyKid’s customers are now running the most up to date and secure version of WordPress core, version 3.4.1. The upgrade process started yesterday around 5 minutes after 3.4.1 was announced, and finished around 8am. Some of you may have noticed a short down time, or a maintenance message window. 

Due to the nature of some customizations to themes by some customers, we have not upgraded themes. 

We’re currently experiencing an issue with one of our clusters that’s causing high Disk IO. This is causing sites to perform slowly or not at all.

We’re working with Rackspace to determine the cause of this issue and get it resolved ASAP. We apologize for any issues this is causing and we’ll update you as soon as we know more.

UPDATE 2:30PM CST: The cause of the issue has been identified and we’re working with Rackspace to solve the problem. The solution will likely result in the migration of the cloud server from one physical host machine to another. This is currently resulting in sites to be down (a combination of the move and migration). We’re expecting things to return to normal once the migration has been completed. However, at this time we don’t have an ETA.

Sorry for the trouble, and if you have any questions, please don’t hesitate to email help@zippykid.com.

UPDATE 5:00PM CST: The Cloud Server is in the process of being migrated from the existing host machine to a new one. During most of this time things should remain up. During the last few minutes of the migration sites will go down while the move is completed and brought up in the new location. We don’t expect this outage or the ongoing issues to last much longer.

UPDATE 9:10PM CST: The final pieces of the migration to the new system are happening now. This is causing sites affected by today’s issue to be offline. We don’t expect this piece of the outage to last too long, but we’re closely monitoring the situation.

UPDATE 9:25PM CST: The Migration of the cloud server to a new host machine has completed and service should be returning to normal. We’re not expecting anymore outages or issues with this system. If you continue to experience problems, or have any questions, please don’t hesitate to email help@zippykid.com.

Thanks for your patience today while we worked through this issue!

We noticed that one of our MySQL Replicants (Slave) was out of sync by a few hours. So, some of you may have been serving up stale content. We’ve fixed the issue and things should be getting back in sync. 

We’re looking into why it took us so long to find this problem. Sorry for any confusion this may have caused you. 

On June 5th, 2012 at 10:00 PM CDT our engineers will perform maintenance to our Cloud Load Balancer infrastructure. In an attempt to roll out a new feature on Cloud Load Balancer, a server restart is required. While we do not anticipate any impact, there is a small possibility of as much as a 10-minute window where service may be interrupted. We are confident that this maintenance will be completed on, or before June 6th at 12:01 AM CDT.

We apologize for any inconvenience this may cause and thank you for your patience and understanding. If you have any questions please don’t hesitate to email help@zippykid.com.

We’re currently experiencing an issue with our Rack Connect system that connects our Cloud and Dedicated hardware. This is causing the connection interruption between our web servers and database servers. We’re working with Rackspace to resolve this as soon as possible.

Sorry about the issues, and we’ll be sure to update you when we know more.

UPDATE 1:00PM CST: The connection between our Cloud and Dedicated Environment has been restored now. We’re seeing our systems come back online now and don’t expect to see another issue related to this. If you’re still experiencing issues with your site, please don’t hesitate to email help@zippykid.com and let us know.