View Single Post
Old 06-01-2008, 02:53 PM
David's Avatar
David David is offline
Fed-X is Back!

Join Date: Nov 2001
Location: Texas, USA
Posts: 20,855
Thanks: 3,439
Thanked 7,841 Times in 1,601 Posts
Default Houston Data Center fire / explosion takes PTO off line.. June 1, 2008

While PTO is hosted up in Dallas (Colo4Dallas) at this time, a major outage at a Data Center in Houston (The Planet - Data Center 1) took us off line for a significant amount of time yesterday and today.

Since our hosting move back up to Dallas from Houston we have had our Domain Name Services handled by a server that unfortunately was in the data center in Houston which is now having major problems. From what I have been told they had a power transformer explode and take out the power in the data center. The fire department would not let them run their backup generators so no power = no servers online.

After I was notified that the data center had a major problem that took PTO offline, our server admin and I worked to transfer the DNS back to our server in Dallas. I initiated the change with my domain registrar around 1:45 this morning, however it can take up to 24-48 hours to completely propagate around the world, so while some people are able to access PTO, others may not. I can't access it with my Cable Internet still, but I can with my Verizon Wireless now..

I wish I could say all of this down time is due to upgrading the servers and moving them to the new data center, but unfortunately not.

I apologize for not making a post about this in the forum, but when I went to sleep last night I thought it would only take an hour at most, and I was exhausted. I forgot that this wasn't just a simple Name Server change...

Hopefully everyone will get service back asap!


~~Update 8PM~~

I had plans to go up to the North Side of Houston to visit family and decided to drop by the data center on the way and snap a few pictures... I only had a little point & shoot camera so they are not all that great, but better than nothing.

I don't think I have ever seen so many electric company vehicles (and people) even on a new construction project as they have there at this moment. There were at least 12 company trucks and about 5 large mobile generator units and a lot of activity. No surprise there. I'm just glad we were able to change our DNS and are now back online. Hopefully all the people affected by this will be as well soon. A number of years ago when we still had leased dedicated servers, PTO was housed in this very building and on the first floor where most of the damage took place.
Attached Images
File Type: jpg theplanet-h1-a.jpg (84.8 KB, 1936 views)
File Type: jpg theplanet-h1-b.jpg (92.2 KB, 1307 views)
File Type: jpg theplanet-h1-c.jpg (93.1 KB, 1951 views)
File Type: jpg theplanet-h1-d.jpg (125.4 KB, 2739 views)
File Type: jpg theplanet-h1-e.jpg (88.3 KB, 1368 views)
File Type: jpg theplanet-h1-f.jpg (153.0 KB, 2025 views)
File Type: jpg theplanet-h1-g.jpg (88.9 KB, 1929 views)
File Type: jpg theplanet-h1-h.jpg (89.6 KB, 2181 views)
File Type: jpg theplanet-h1-i.jpg (117.9 KB, 1337 views)
File Type: jpg theplanet-h1-j.jpg (136.3 KB, 1553 views)
"Too often ... people enjoy the comfort of opinion without the discomfort of thought" - Leapfrog
Reply With Quote
The Following 6 Users Say Thank You to David For This Useful Post:
cnk (06-02-2008), FAITHHOPELOVE (06-02-2008), LovingSoul4u2 (06-04-2008), pinkkrazr (06-01-2008), PTO-110524 (06-02-2008), wendy tyler (06-01-2008)
Sponsored Links