Slicehost - Home

Network Issues in DFW1

2012-05-01T20:38:00Z

Update: As of 11:00am CDT the network issue has been resolved. Please don't hesitate to let us know if you continue to see further issues. As always we can be reached at https://chat.slicehost.com or support@slicehost.com.

Update: As of 10:00 AM CDT - The transient networking issues are still ongoing and we're investigating further as to the source of this trouble. This issue is affecting a small portion of our customers in the DFW1 datacenter. As always, please come by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com) if you have any questions.

Update: As of sometime before 8:50 pm - seems to have passed. No cause pinpointed. Let us know if you are still seeing issues.

Update: As of 4:55pm CDT we are stil investigating the cause of intermittent networking issues affecting a portion of customers in our DFW1 datacenter. Please feel free to swing by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com)

Update: As of 4:25pm CDT we are still investigating the cause of the intermittent issues affecting some customers in our DFW1 datacenter. As always, please swing by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com) if you have any further questions.

We are currently experiencing some network connectivity issues in a portion of our DFW1 Datacenter. Our engineers are currently working to resolve this issue. Updates will be posted to this page as they become available.

Please feel free to swing by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com) if you have any further questions or concerns.

STL-B Network Maintenance

2012-04-12T21:26:00Z

[UPDATE] - STL-B Maintenance has been completed successfully. Please contact us directly via SliceChat or via email at support@slicehost.com if you have any additional questions.

Slicehost Engineers will be performing a network maintenance in our STL-B data center on Saturday, April 14th from 12:00AM - 2:00AM CDT (5:00-7:00 UTC). The impact is expected to be minimal, but you may experience a brief period of intermittent connectivity to any slices located in our STL-B data center.

If you have any questions or concerns please get in touch with our support team by visiting SliceChat or via email at support@slicehost.com. Thank you for your patience and understanding.

DATE: April 14th, 2012

TIME: 12:00AM-2:00AM CDT (5:00-7:00 UTC)

IMPACT: There may be a brief period of intermittent connectivity to any slices located in our STL-B data center.

STL-A Network Issues

2012-04-04T17:47:00Z

Update @ 4:00PM CDT: We have performed a network maintenance to route traffic away from the STL-A data center and avoid future incidents such as this. Customers who have migrated their slices from STL-A to ORD will no longer be affected by any future STL-A disruptions. Slices remaining in STL-A will continue to function as normal. We sincerely apologize for the disruption.

Update: As of 2:44pm CDT the network issue has been resolved and connectivity restored to slices in STL-A and slices migrated from STL-A to ORD1. If you have any additional questions or are still having issues, please don't hesitate to swing by chat or shoot us an email, support@slicehost.com.

Update @ 2:15PM CDT - The initial cause of network issues appears to be a large DoS attack. The STL-A datacenter engineers are actively working to restore network connectivity to all slices affected by this incident. As always, please swing by chat or shoot us an email at support@slicehost.com if you have any additional questions.

Update: This issue impacts slices migrated from STL-A to ORD1 as well as slices still located in STL-A.

We are currently experiencing some network connectivity issues in a portion of our STL-A Datacenter. Our engineers are currently working to resolve this issue. Updates will be posted to this page as they become available.

Please feel free to swing by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com) if you have any further questions or concerns.

STL-B Network Maintenance

2012-03-22T18:42:00Z

Update: The scheduled maintenance for the STL-B datacenter has been postponed, and will be rescheduled for a future date.

Slicehost Engineers will be performing a network maintenance in our STL-B data center on Sunday, March 25th from 2:00AM - 4:00AM CDT (7:00-9:00 UTC). The impact is expected to be minimal, but you may experience a brief period of intermittent connectivity to any slices located in our STL-B data center.

If you have any questions or concerns please get in touch with our support team by visiting SliceChat or via email at support@slicehost.com. Thank you for your patience and understanding.

DATE: March 25th, 2012

TIME: 2:00AM-4:00AM CDT (7:00-9:00 UTC)

IMPACT: There may be a brief period of intermittent connectivity to any slices located in our STL-B data center.

STL-A Network Maintenance

2012-03-20T16:16:00Z

Update 1:30am CST: This maintenance has been successfully completed.
Update 10:00pm CST: Maintenance underway
Update 10:35pm CST: Connectivity to STL-A Slices and Slices that have migrated to ORD lost. We have notified the data center of this issue and they are currently investigating.
Update 10:39pm CST: Connectivity restored

On Wednesday, March 21st, from 10:00PM - 3:00AM CDT (03:00 - 08:00 UTC - March 22nd), our STL-A data center provider will be installing a new core switch in that facility. There is no planned interruption expected, but customers may experience intermittent connectivity to their slices while the switch is introduced into the network.

If you have any questions or concerns please get in touch with our support team by visiting SliceChat or via email at support@slicehost.com. Thank you for your patience and understanding.

DATE: March 21st, 2012

TIME: 10:00PM-3:00AM CDT (03:00-08:00 UTC - March 22nd)

IMPACT: While we do not expect any customer impact, slices may experience intermittent connectivity issues while the switch is introduced into the network. Additionally, this could potentially impact slices that were originally located in STL-A, but have been transferred to ORD.

STL-B Network Maintenance

2012-03-08T21:08:00Z

Slicehost Engineers will be performing a network maintenance in our STL-B data center on Sunday, March 11th from 2:00AM - 3:00AM CST (8:00-9:00 UTC). The impact is expected to be minimal, but you may experience a brief period of intermittent connectivity to any slices located in our STL-B data center.

If you have any questions or concerns please get in touch with our support team by visiting SliceChat or via email at support@slicehost.com. Thank you for your patience and understanding.

DATE: March 11th, 2012

TIME: 2:00AM-3:00AM CST (8:00-9:00 UTC)

IMPACT: There may be a brief period of intermittent connectivity to any slices located in our STL-B data center.

SliceManager Login Issues

2012-03-07T21:09:00Z

UPDATE 5:00PM CST - The login issues for the SliceManager should be resolved at this time.

Please let us know if you continue to experience any problems.

UPDATE 4:45 CST - We have identified the issue and logins should begin working as expected in the next few minutes.

UPDATE 4:30 CST - While many customers are able to successfully login, we are aware that some customers are still experiencing issues. Our engineers will continue to investigate this issue until it is fully resolved.

We are aware that some customers are experiencing problems when attempting to login to the SliceManager. Our engineers are currently investigating the issue and updates will be posted to this page as they become available.

Please feel free to swing by chat (https://chat.slicehost.com) or contact us via email at (support@slicehost.com) if you have any further questions or concerns.

Network issues in ORD1

2012-03-05T05:19:00Z

Update 2:13am: Networking restored

Update 2:00am: We are experiencing a network outage for some slices in ORD1

Update 12:20 am: Connectivity restored

A small number of slices in ORD1 are experiencing a network outage.

We are investigating and hope to have connectivity restored shortly.

STL-A Core Switch Maintenance

2012-03-01T15:04:00Z

UPDATE 3/4/2012 @7:30 am CST - Connectivity to STL-A has been restored, and slices should be responding again. If you continue to see intermittent connectivity to your slice, please visit us in chat or contact our support team at support@slicehost.com

UPDATE 3/4/2012 @6:45 am CST - Networking teams are still working to restore connectivity to the STL-A datacenter.

UPDATE 3/4/2012 @5:30 am CST - Rackspace and Datacenter engineers are still working to restore connectivity to our STL-A datacenter

UPDATE 3/4/2012 @4:00 am CST - Datacenter engineers are continuing to work on the connectivity issues in our STL-A datacenter.

UPDATE 3/4/2012 @3:10 am CST - STL-A and Slices that recently migrated from STL-A are having network connectivity issues right now. We are in contact with the Datacenter attempting to restore connectivity as soon as possible.

UPDATE on 03/02/2012 @12:15 PM CST - Slices migrated from STL-A to ORD1 that were able to retain their existing public IP address will be impacted by this maintenance on those IP addresses. Slices that migrated from STL-A to ORD1 and received a new public IP address will not be impacted on those IP addresses.

UPDATE on 03/02/2012 @ 9:25 AM CST - The maintenance time has been adjusted by Datotel and has been pushed back to start at 10:00 PM on March 3rd 2012 running through 3:00 AM March 4th 2012. The updated information is listed below.

On Saturday, March 3rd 2012, from 10:00 PM - 03:00 AM CST (04:00 - 09:00 UTC Sunday March 4th 2012), Datotel Engineers will be installing a replacement core switch as a result of the service interruption on February. Intermittent connectivity issues to slices in STL-A are expected during the maintenance,

If you have any questions or concerns, please visit us in chat or contact our support team at support@slicehost.com

DATE: March 3rd 2012 into March 4th 2012

TIME: 10:00 PM - 3:00 AM CST (04:00 - 09:00 UTC Sunday March 4th 2012)

IMPACT: There will be intermittent connectivity issues to slices located in our STL-A data center.

Slicehost.com is Back

2012-03-01T04:38:00Z

We are happy to announce that the slicehost.com site is back up and running at this time and we do not anticipate any further issues. The forum.slicehost.com site still remains down, however. In the meantime please feel free to visit our other resources of information such as the articles site or the Rackspace Knowledge Center as our operations team is still in the process of archiving the forum data for historical purposes and we will be bringing that back online as soon as possible.

If you have any questions or concerns, please swing by chat or email us at support@slicehost.com.

Slicehost.com Undergoing Maintenance

2012-02-28T18:01:00Z

UPDATE on 02/29/2012 @ 10:55PM CST - The slicehost.com site is back up and running. Please review this status post for further information.

UPDATE on 02/29/2012 @ 1:00 PM CST - Our engineers and operations team are continuing the maintenance of the slicehost.com and forum.slicehost.com sites. We are currently in the process of migrating the slicehost.com site to new hardware and we have run into some unexpected issues with the process but we anticipate having the site back online soon. Access to your slices, the API and the SliceManager remains unaffected and we will update further once the main site is back online and functioning as expected. As always, please swing by chat or shoot us an email at support@slicehost.com if you have any questions or concerns.

UPDATE @ 6:35PM CST - Our engineers are still performing maintenance on the slicehost.com site and working as quickly as possible to restore accessibility. Your slices and access to the API and SliceManager remain unaffected but please swing by chat or email us at support@slicehost.com if you have any questions or concerns.

Slicehost.com is currently undergoing maintenance and may be inaccessible during this time frame. Neither your slices nor the SliceManager will be affected by this. You can still login to your slices as well as the SliceManager.

If you have any questions or concerns, please don't hesitate to drop by chat or shoot us an email at support@slicehost.com.

We will update this post further once the maintenance is complete and slicehost.com is back up and running normally.

DFW Networking Issues

2012-02-22T14:33:00Z

UPDATE @ 8:53 AM CST: This issue should be resolved at this time.

We are experiencing some network connectivity issues in a portion of our DFW datacenter. Our engineers are currently working to resolve this issue. Updates will be posted to this page as they become available.

Please feel free to swing by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com) if you have any further questions or concerns.

STL-A Ongoing Network Issues

2012-02-14T16:17:00Z

UPDATE @ Friday, Feb. 17th - We wanted to give everyone an update and let you know that we are still working to provide you the full details of this incident. We apologize for the delay while we work through this process.

If you have any additional questions or concerns, please visit us in our chat room (https://chat.slicehost.com) or shoot us an email (support@slicehost.com)

UPDATE @ 4:50PM CST - We believe the network connectivity issues in our STL-A data center to be resolved at this time and have not experienced any further issues as of 2:20PM CST this afternoon. Additionally, we have requested an RCA from our vendor and will share that information with you as soon as it is available.

If you continue to experience any issues, please contact us immediately in chat (https://chat.slicehost.com) or via email (support@slicehost.com)

UPDATE @ 2:55PM CST - Our operations team has been in constant contact with the data center technicians located in STL-A as we continue to investigate this ongoing incident. We are truly sorry for the issues this has caused and will provide further information as soon as we can.

UPDATE @ 1:25PM CST - We continue to coordinate efforts with the STL-A data center engineers to provide a resolution to this issue as soon as possible. We will post any additional information as soon as it is received.

UPDATE @ 12:20PM CST - Our data center provider is still attempting to replace the faulty networking hardware in the STL-A facility. Until this has been fully completed, your slice(s) will continue to experience intermittent connectivity.

UPDATE @ 11:05AM CST - Our engineers are still working to resolve this issue and we will continue to provide information as it is made available to us. As always, please visit us in chat (https://chat.slicehost.com) or shoot us an email (support@slicehost.com) if you have any additional questions.

We continue to experience intermittent connectivity issues in our STL-A data center. The latest information we have available is that faulty networking hardware is currently being replaced and the connectivity issues are expected to continue for the next hour. As soon as we receive additional information, we will provide it to you in this post.

Please visit us in chat (https://chat.slicehost.com) or via email (support@slicehost.com) if you have any additional questions.

DFW and ORD Critical Maintenance

2012-02-13T21:38:00Z

Slicehost will conduct an critical maintenance in two parts tonight, Monday, February 13th, 2012 beginning at 4:00 PM CST (10:00 PM GMT) and last until 8:00 PM CST (2:00 AM GMT). This maintenance will affect a very small group of customers in our DFW data center. Throughout this maintenance, some customers may experience intermittent periods of degraded performance. Furthermore, re-sizes, rebuilds, snapshots and new slice builds will be unavailable until the maintenance window is complete.

The second part of this maintenance will begin Tuesday, February 14th at 12:00 AM CST (6:00 AM GMT) until 4:00 AM CST (10:00 AM GMT). This will affect a very small group of customers in the ORD data center. Customers may experience intermittent periods of degraded performance. Furthermore, re-sizes, rebuilds, snapshots and new slice builds will be unavailable until the maintenance window is complete.

We apologize for any inconvenience this may cause. Thank you for your patience and understanding. If you have any further questions, please contact a member of our support team by visiting us in SliceChat or via email at support@slicehost.com.

STL-A Networking Issues

2012-02-13T20:58:00Z

UPDATE @ 10:15AM CST Please refer to this post for additional updates.
UPDATE @ 9:45AM CST - We are aware that some customers may still be experiencing an issue connecting to their slice located in our STL-A data center. Our engineers continue to work with our data center provider in order to fully resolve this issue. We will update this post as soon as we have additional information to provide.
UPDATE @ 9:35AM CST - Services have been restored and all slices should be coming back online. We will provide additional information regarding this incident as soon as possible. If you are still experiencing issues with your slice located in STL-A, please visit us in chat at https://chat.slicehost.com or via email (support@slicehost.com).
UPDATE @ 05:40AM CST - We understand this outage is due to a router issue. Specialist engineers are on site troubleshooting but still no fix ETA available as yet.
UPDATE @ 02:12AM CST - We are waiting on the DC to get things back online. No ETA available.
UPDATE @ 7:35PM CST - We have located the hardware causing the issues and are currently working to route around it. Unfortunately we're still unable to provide an ETA at this point.
UPDATE @ 4:50PM CST - Our engineers are still working to resolve the network issues affecting some customers in STL-A. Please continue to submit tickets or swing by chat at https://chat.slicehost.com if you have any questions.

Please feel free to swing by chat (https://chat.slicehost.com) or shoot us a ticket (support@slicehost.com) if you have any further questions or concerns.

UPDATE - Our engineers in the STL data center are currently looking at what they believe to be the cause of the issue. Please note that even though your slice may report in the Slicemanager as being located in ORD, if you were originally in STL, and haven't migrated yet yourself, you are probably still in the STL data center.

As always, we are available at http://chat.slicehost.com