Author Archives: Roberto

Rackspace Scheduled Maintenance (UPDATED)

Update (3/23/16): Rackspace has scheduled additional maintenance for Thursday, March 23. Please check the maintenance schedule below to see if your site(s) will be impacted.

Rackspace will be performing scheduled maintenance on several servers over the coming week beginning on Monday, March 21. The maintenance schedule is as follows:

Note: You can identify which galaxy your site(s) are on by referencing the following knowledge base article:

How do I Identify what cluster my site is on?

Monday, March 21 at 9:00pm to Tuesday, March 22 at 3:00am Central

There may be brief disruption of service to customers on the following galaxies in our IAD datacenter:

  • Cartwheel
  • Hyperion
  • Pegasus
  • Shadowfax

Wednesday, March 23 from 12:00am to 5:00am Central

A small number of customers on the following galaxies in our IAD datacenter may experience a brief interruption in their SSH connectivity:

  • Hyperion
  • Pegasus
  • Shadowfax

Wednesday, March 23 at 10:00pm to Thursday, March 24 at 4:30am Central

There may be brief disruption of service and intermittent slowness to customers on the following galaxies in our ORD datacenter:

  • Galaxy01
  • Thor
  • Bode
  • Hydra
  • Ursa

Thursday, March 23 from 9:00pm to 11:00pm Central

There may be brief disruption of service to customers on the following galaxies in our IAD datacenter:

  • Cartwheel
  • Hyperion
  • Pegasus
  • Shadowfax

Friday, March 25 from 3:00am to 4:00am Central

There may be brief disruption of service to customers on the following galaxies in our IAD datacenter:

  • Hyperion
  • Pegasus
  • Shadowfax
  • Cartwheel

If you have any questions or concerns about this maintenance, please reach out to us by email (help@pressable.com) or submit a ticket for our Help Desk through the MyPressable Control Panel (https://my.pressable.com).

Thank you!

Emergency Maintenance in Virginia Datacenter

We have just begun a period of Emergency Maintenance in our Virginia Datacenter. We discovered an issue this morning that was causing trouble with files being uploaded properly to sites. This turns out to be related to an issue on the file server that houses data on the clusters in our Virginia Datacenter.

This emergency maintenance is currently underway and sites in the Virginia DC will experience a small window of downtime that is starting right now.

We will update this status blog again as soon as sites and the file server are back up.

UPDATE 3:00 PM Central: The period of emergency maintenance concluded at around 1:45PM Central time. At this point all sites affected had availability restored and service returned to normal. As of this update, all systems are now back up and functioning normally again.

If you have any questions or concerns, please contact our help desk by submitting a ticket via your https://my.pressable.com control panel.

Upload Issues In Virginia Datacenter

We are currently experiencing an issue in our Virginia datacenter that is causing uploads via the WordPress Dashboard to fail. All affected sites remain up and available otherwise.

We are working on getting this resolved as quickly as possible and will provide an update as soon as we have further insight or resolution.

UPDATE 1:25PM Central: This issue has resulted in us needed to perform emergency maintenance on the file server that houses sites in this datacenter. You can find out more about the maintenance itself here: http://status.pressable.com/2016/01/24/emergency-maintenance-in-virginia-datacenter/

We will update again as soon as this issue has been resolved and you can keep an eye on the other status post for emergency maintenance progress.

UPDATE 3:00PM Central: The emergency maintenance period concluded around 1:45 PM Central and was a success. The results of this maintenance was essential toward getting the upload issue resolved and everything is now functioning normally. All sites in our Virginia datacenter are up, running, and have upload functionality working properly again.

If you have questions or concerns, please contact our help desk by submitting a ticket from your https://my.pressable.com panel.

Network Connectivity Issues

UPDATE 11/20/15 @ 11:00AM Central:
The connectivity issue that Rackspace experienced between their ORD (Chicago) data center and Time Warner Cable has been resolved, and all services have returned to normal. At this time, all sites should be accessible. If you experience any issues with your sites, please open a support ticket (support@pressable.com) so that we may assist you.

INITIAL NOTICE:
We are currently experiencing network connectivity issues in sites based out of our ORD datacenter.

We are working with Rackspace to see when they expect these issues to be resolved and will update here as we know more.

If you have questions or concerns, please submit a ticket via https://my.pressable.com

UPDATE 11/20/15 @ 6:00AM Central:
Rackspace has informed us that they are experiencing connectivity and latency issues from Time Warner Cable. We are staying in close contact with them as this issue persists and will continue to update our status blog accordingly.

UPDATE 11/20/15 @ 7:15AM Central:
Service is returning to normal at this point. We are working on bringing all servers back to normal and as a result, sites may be still experience issues loading. We will update again as soon as service has been restored completely.

Emergency Security Maintenance

Howdy,

We received notice this afternoon that our provider, Rackspace, has identified a vulnerability in Xen Hypervisor. This vulnerability has been patched by Rackspace but it requires a reboot of cloud servers in order to for it to take.

You can read more about the vulnerability and requirements here:

https://community.rackspace.com/general/f/53/t/5187
http://venom.crowdstrike.com

We have elected to reboot cloud servers in our network at our discretion rather than allowing Rackspace to reboot using a maintenance window approach.

We will begin the process of rebooting cloud servers tonight, May 13th, at 10:00 PM Central time. We expect this process to take several hours and customers will see intermittent outages of varying length.

We will update this page when the maintenance is completed.

If you have any questions or concerns, please contact our help desk.

We apologize in advance for any inconvenience this may cause and are working toward addressing this as smoothly as possible.

Thank you!

UPDATE – May 14th, 2015 @ 2:57 AM Central: We have completed the reboots that are necessary as a part of this vulnerability patch. All systems are back up, running, and stable. Thank you for your patience and please let us know if you have any questions. Thanks!

XSS Vulnerability Affecting Multiple WordPress Plugins

The Sucuri Blog has notified users of multiple WordPress plugins that are vulnerable to Cross-site Scripting (XSS) attacks. Listed are some of the more popular plugins used in the WordPress community:

https://blog.sucuri.net/2015/04/security-advisory-xss-vulnerability-affecting-multiple-wordpress-plugins.html

The nature of this vulnerability makes it difficult to patch completely/comprehensively because so many plugins use the functions listed as being misused.

We highly recommend logging into your WordPress Dashboard and updating any plugins that have available updates.

If you have any questions or concerns, please contact our help desk by submitting a ticket via your https://my.pressable.com panel.

Chicago Datacenter Issue – RESOLVED

Howdy,

We just finished dealing with an issue in our Chicago datacenter that was causing several other clusters to experience instability. Our “Ursa” cluster was taking on an extreme amount of traffic that looks to be, in large part, a bot attack.

This happened as a result of the “Ursa” cluster having a set of tools not running appropriately that detects and mitigates issues like this.

We’ve cleared this up and all sites are now back up and running appropriately.

If you have any questions or concerns, please contact our help desk via your https://my.pressable.com control panel.

Thank you!