Welcome to the Prison Talk Online Community! Take a Minute and Sign Up Today!






Go Back   Prison Talk > WELCOME TO PTO > PTO News, Information & Events
Register Entertainment FAQ Calendar Mark Forums Read

Notices

PTO News, Information & Events What's new, and what is coming to our web community. Administrative notices and information.

Reply
 
Thread Tools Display Modes
  #1  
Old 06-01-2008, 02:53 PM
David's Avatar
David David is offline
20k posts one day..
Donation Award 
 

Join Date: Nov 2001
Location: Texas, USA
Posts: 19,239
Thanks: 1,388
Thanked 5,112 Times in 696 Posts
Default Houston Data Center fire / explosion takes PTO off line.. June 1, 2008

While PTO is hosted up in Dallas (Colo4Dallas) at this time, a major outage at a Data Center in Houston (The Planet - Data Center 1) took us off line for a significant amount of time yesterday and today.

Since our hosting move back up to Dallas from Houston we have had our Domain Name Services handled by a server that unfortunately was in the data center in Houston which is now having major problems. From what I have been told they had a power transformer explode and take out the power in the data center. The fire department would not let them run their backup generators so no power = no servers online.

After I was notified that the data center had a major problem that took PTO offline, our server admin and I worked to transfer the DNS back to our server in Dallas. I initiated the change with my domain registrar around 1:45 this morning, however it can take up to 24-48 hours to completely propagate around the world, so while some people are able to access PTO, others may not. I can't access it with my Cable Internet still, but I can with my Verizon Wireless now..

I wish I could say all of this down time is due to upgrading the servers and moving them to the new data center, but unfortunately not.

I apologize for not making a post about this in the www.PrisonTalkBackup.com forum, but when I went to sleep last night I thought it would only take an hour at most, and I was exhausted. I forgot that this wasn't just a simple Name Server change...

Hopefully everyone will get service back asap!

Thanks,
David

~~Update 8PM~~

I had plans to go up to the North Side of Houston to visit family and decided to drop by the data center on the way and snap a few pictures... I only had a little point & shoot camera so they are not all that great, but better than nothing.

I don't think I have ever seen so many electric company vehicles (and people) even on a new construction project as they have there at this moment. There were at least 12 company trucks and about 5 large mobile generator units and a lot of activity. No surprise there. I'm just glad we were able to change our DNS and are now back online. Hopefully all the people affected by this will be as well soon. A number of years ago when we still had leased dedicated servers, PTO was housed in this very building and on the first floor where most of the damage took place.
Attached Images
File Type: jpg theplanet-h1-a.jpg (84.8 KB, 1936 views)
File Type: jpg theplanet-h1-b.jpg (92.2 KB, 1307 views)
File Type: jpg theplanet-h1-c.jpg (93.1 KB, 1951 views)
File Type: jpg theplanet-h1-d.jpg (125.4 KB, 2739 views)
File Type: jpg theplanet-h1-e.jpg (88.3 KB, 1368 views)
File Type: jpg theplanet-h1-f.jpg (153.0 KB, 2025 views)
File Type: jpg theplanet-h1-g.jpg (88.9 KB, 1929 views)
File Type: jpg theplanet-h1-h.jpg (89.6 KB, 2181 views)
File Type: jpg theplanet-h1-i.jpg (117.9 KB, 1337 views)
File Type: jpg theplanet-h1-j.jpg (136.3 KB, 1553 views)
__________________
"Too often ... people enjoy the comfort of opinion without the discomfort of thought" - Leapfrog

Are you having account or other issues at PTO? If so, use the...


Reply With Quote
The Following 6 Users Say Thank You to David For This Useful Post:
cnk (06-02-2008), FAITHHOPELOVE (06-02-2008), LovingSoul4u2 (06-04-2008), pinkkrazr (06-01-2008), PTO-110524 (06-02-2008), wendy tyler (06-01-2008)
Sponsored Links
  #2  
Old 06-01-2008, 02:58 PM
David's Avatar
David David is offline
20k posts one day..
Donation Award 
 

Join Date: Nov 2001
Location: Texas, USA
Posts: 19,239
Thanks: 1,388
Thanked 5,112 Times in 696 Posts
Default The Planet Data Center in Houston fire

Here is a news report yesterday about what took place.

Quote:
May 31, 2008 - Newsblaze

Tonight at 5:45 p.m. in Houston, Texas, a transformer in The Planet H1 datacenter caught fire. The fire department required them to take down all generators.

This significant outage is impacting around 9,000 servers and 7,500 customers.

Luckily, there were no injuries. It is now known that there was an explosion that knocked down three walls surrounding the electrical equipment room.

All servers in the H1 data center are down. This was the EV1servers old datacenter, that houses the main name servers for many of the dedicated hosting servers, we well as the ServerCommand customer portal, that legacy Ev1servers customers use to control their servers and add domain records.

The name servers and the ServerCommand system were still down, five hours later. ThePlanet staff said they are working to move the ServerCommand and the Name Servers to another data center.

According to staff, their management team and facilities staff are on site evaluating the situation.

"In our latest assessment, we have determined that networking gear has not been damaged, but we are without power so assessments continue. All disaster recovery systems are in motion, and we have teams already working in the data center."

According to customer support, one of their forum threads is being used to keep customers informed.

They report that their new Orbit system is not affected.

When NewsBlaze asked, they said "According to the last update, power should be restored in the data center tomorrow afternoon."

It is to be hoped they improve their disaster recovery plans after this. Having nameservers that control domains in other datacenters should not be a difficult problem to overcome.

NewsBlaze, Daily News
__________________
"Too often ... people enjoy the comfort of opinion without the discomfort of thought" - Leapfrog

Are you having account or other issues at PTO? If so, use the...


Reply With Quote
  #3  
Old 06-01-2008, 03:01 PM
FriscoLady's Avatar
FriscoLady FriscoLady is offline
Banned
Donation Award 
 

Join Date: Apr 2002
Location: Out there somewhere
Posts: 9,630
Thanks: 2,289
Thanked 2,385 Times in 1,088 Posts
Default

Thanks David for th Info! We are back in touch here in VA at least, hopefully everywhere soon!

Patti
Reply With Quote
  #4  
Old 06-01-2008, 03:52 PM
wendy tyler's Avatar
wendy tyler wendy tyler is offline
Registered User
 

Join Date: Nov 2007
Location: QUERETARO, MEXICO
Posts: 3,807
Thanks: 11,238
Thanked 5,986 Times in 2,051 Posts
Default

Back on down here in Mexico, too! Lordy I thought it was a south of the border thing that I wouldn't get fixed for ever.
__________________
Reply With Quote
  #5  
Old 06-01-2008, 03:56 PM
SMILE*4*ME's Avatar
SMILE*4*ME SMILE*4*ME is offline
Registered User
 

Join Date: Jul 2006
Location: Near Him, Texas/US
Posts: 192
Thanks: 242
Thanked 64 Times in 41 Posts
Default

Houston is back up
__________________
My waits
Reply With Quote
  #6  
Old 06-01-2008, 04:17 PM
justadeb's Avatar
justadeb justadeb is offline
Registered User
Donation Award 
 

Join Date: Feb 2008
Location: south
Posts: 2,800
Thanks: 2,509
Thanked 5,498 Times in 1,923 Posts
Default

florida up
__________________

Life can only be understood backward, but it must be lived forward. ~Soren Kierkegaard

Reply With Quote
  #7  
Old 06-01-2008, 04:32 PM
jmbaby's Avatar
jmbaby jmbaby is offline
Registered User
Donation Award 
 

Join Date: Apr 2007
Location: N.California
Posts: 813
Thanks: 309
Thanked 311 Times in 165 Posts
Default

California back up. I thought it was my computer acting up.
__________________
Hear, O Israel, The LORD our GOD is ONE LORD, and thou shalt love the LORD thy God with all thine heart, and with all thy soul, and with all thy might. Deuteronomy 6:4,5

My Love Bug is HOME as of 2/12/13
Reply With Quote
  #8  
Old 06-01-2008, 04:35 PM
David's Avatar
David David is offline
20k posts one day..
Donation Award 
 

Join Date: Nov 2001
Location: Texas, USA
Posts: 19,239
Thanks: 1,388
Thanked 5,112 Times in 696 Posts
Default

Houston Comcast still is down for me..
__________________
"Too often ... people enjoy the comfort of opinion without the discomfort of thought" - Leapfrog

Are you having account or other issues at PTO? If so, use the...


Reply With Quote
  #9  
Old 06-01-2008, 05:21 PM
SaintsBabyGirl's Avatar
SaintsBabyGirl SaintsBabyGirl is offline
The Saints Baby
 

Join Date: Nov 2007
Location: Maryland
Posts: 285
Thanks: 10
Thanked 25 Times in 22 Posts
Default

WooHoo Maryland is up! Thanks for the info and all your hard work David.
__________________







Reply With Quote
  #10  
Old 06-01-2008, 05:23 PM
Patty's Avatar
Patty Patty is offline
WINNING! Admin

PTOQ Editorial Team Member 

Donation Award 
 

Join Date: Nov 2003
Location: Rockford, Illinois
Posts: 38,154
Thanks: 16,001
Thanked 37,435 Times in 10,405 Posts
Default

Illinois in da house, now fix the chatroom, David!

Patty
__________________
For those who can, contributions to keep PTO up and running are most welcome HERE

THIS CORRESPONDENCE
IS FROM A WOMAN IN LOVE
WITH A FORMER INMATE OF
THE ILLINOIS DEPARTMENT
OF CORRECTIONS





Reply With Quote
  #11  
Old 06-01-2008, 05:25 PM
pinkkrazr's Avatar
pinkkrazr pinkkrazr is offline
Live and Learn~
Donation Award 
 

Join Date: May 2008
Location: NC
Posts: 1,184
Thanks: 539
Thanked 539 Times in 367 Posts
Default

North Carolina is up...David you are awesome for getting us back up so quickly!!! Thank you!!
Reply With Quote
  #12  
Old 06-01-2008, 05:42 PM
soalone17's Avatar
soalone17 soalone17 is offline
Registered User
 

Join Date: Jan 2006
Location: was CT now NM
Posts: 2,065
Thanks: 244
Thanked 71 Times in 55 Posts
Default

Connecticut is up...
__________________







Reply With Quote
  #13  
Old 06-01-2008, 06:43 PM
Sassy7 Sassy7 is offline
Registered User
 

Join Date: Dec 2005
Location: from here to eternity...........
Posts: 122
Thanks: 50
Thanked 15 Times in 12 Posts
Default

Houston by way of California is back up and running. David you are awesome, thanks for all of your hard work.
Reply With Quote
  #14  
Old 06-01-2008, 06:45 PM
Waitin_4_J's Avatar
Waitin_4_J Waitin_4_J is offline
'til death us do part
 

Join Date: Oct 2007
Location: Mtn City, TN
Posts: 1,008
Thanks: 1,317
Thanked 765 Times in 388 Posts
Default

TN seems to finally be up.
__________________




Reply With Quote
  #15  
Old 06-01-2008, 07:14 PM
Rachel's Avatar
Rachel Rachel is offline
Busy Dizzy Admin
Donation Award 
 

Join Date: Aug 2004
Location: Darwin, NT
Posts: 18,447
Thanks: 3,413
Thanked 19,990 Times in 5,052 Posts
Default

Gotcha in Taiwan!!
Thank goodness!!
__________________
PTO Quarterly - Summer Issue is OUT NOW!
Don't miss the latest edition of PTO's very own newsletter.
It's time to get reading!



Download your copy here: PTO Quarterly

Reply With Quote
  #16  
Old 06-01-2008, 07:17 PM
light at end's Avatar
light at end light at end is offline
He's finally Home!!!!!!

Staff Superstar Winner 

 

Join Date: Apr 2006
Location: CA
Posts: 10,675
Thanks: 2,173
Thanked 5,477 Times in 3,266 Posts
Default

Thanks for all your hard work David. Thanks also for posting the back up site info. I never knew there was one.
__________________



Reply With Quote
  #17  
Old 06-01-2008, 07:28 PM
David's Avatar
David David is offline
20k posts one day..
Donation Award 
 

Join Date: Nov 2001
Location: Texas, USA
Posts: 19,239
Thanks: 1,388
Thanked 5,112 Times in 696 Posts
Default

I just updated the first post with pictures after I stopped by the data center (The Planet) where we used to be hosted and had our DNS until we moved it.
__________________
"Too often ... people enjoy the comfort of opinion without the discomfort of thought" - Leapfrog

Are you having account or other issues at PTO? If so, use the...


Reply With Quote
  #18  
Old 06-01-2008, 07:29 PM
brooks's Avatar
brooks brooks is offline
Registered User
 

Join Date: Apr 2006
Location: RI
Posts: 3,549
Thanks: 576
Thanked 1,139 Times in 678 Posts
Default

RI is up, and mine is through the local cable company, though it was off this am.
Reply With Quote
  #19  
Old 06-01-2008, 07:50 PM
Ness's Avatar
Ness Ness is offline
Registered Member
Donation Award 
 

Join Date: Jun 2005
Location: NSW, Australia
Posts: 10,449
Thanks: 1,869
Thanked 2,215 Times in 1,224 Posts
Default

Up and running in Oz!! Glad to be back!!! Have missed this place!!
__________________
Yes from this nightmare, yes I must now wake, open my fist my destiny I take!
Good people sick and tired of being pushed around, we call them kings but I see no crown
Tell me when you think we'll just stand up?
Say enough is enough is enough, enough, I'm saying!!!!
- Revolution - John Butler Trio
Reply With Quote
  #20  
Old 06-01-2008, 08:49 PM
boflipflops36's Avatar
boflipflops36 boflipflops36 is offline
Registered User
 

Join Date: Sep 2006
Location: Decatur, Al
Posts: 3,966
Thanks: 8,069
Thanked 4,121 Times in 1,529 Posts
Default

Houston We Got A Problem!!!!
Until David the man our astronaut fixed it.
Alabama up set to fire!!
Reply With Quote
  #21  
Old 06-02-2008, 12:27 AM
seansbabyluv's Avatar
seansbabyluv seansbabyluv is offline
Banned
Donation Award 
 

Join Date: Sep 2005
Location: ~Hell~
Posts: 5,640
Thanks: 166
Thanked 875 Times in 698 Posts
Default

I can get in now but I'm at work...and not using Comcast so I'll see when I get home.
Reply With Quote
  #22  
Old 06-02-2008, 01:10 AM
David's Avatar
David David is offline
20k posts one day..
Donation Award 
 

Join Date: Nov 2001
Location: Texas, USA
Posts: 19,239
Thanks: 1,388
Thanked 5,112 Times in 696 Posts
Default

My Houston Comcast ISP connection still does not work.. I'm glad I am not paying for this #%^!#$%#$#.. Not that I am glad to pay for Verizon wirless "EVDO" service, but at least I can reach the site with it.. Even in slow-mode where I currently am.
__________________
"Too often ... people enjoy the comfort of opinion without the discomfort of thought" - Leapfrog

Are you having account or other issues at PTO? If so, use the...


Reply With Quote
  #23  
Old 06-02-2008, 01:24 AM
MarcoH64 MarcoH64 is offline
Registered User
Donation Award 
 

Join Date: Aug 2005
Location: the Netherlands
Posts: 670
Thanks: 4
Thanked 58 Times in 26 Posts
Default

Also up in the Netherlands.
Reply With Quote
  #24  
Old 06-02-2008, 06:20 AM
Madhatter's Avatar
Madhatter Madhatter is offline
THE DRAGON LADY
 

Join Date: Aug 2007
Location: Arkansas - Son in CA
Posts: 2,456
Thanks: 276
Thanked 2,163 Times in 860 Posts
Default

I've been going through withdrawals. 36 hours without a PTO "fix". Thank goodness it is back up this morning. Indiana on board.
__________________
Reply With Quote
  #25  
Old 06-02-2008, 10:47 AM
24jf's Avatar
24jf 24jf is offline
Movin forward
Donation Award 
 

Join Date: Oct 2003
Location: PA
Posts: 6,663
Thanks: 2,744
Thanked 2,167 Times in 1,373 Posts
Default

PA with Comcast is finally up and running Having to work on a Monday morning was just about killing me lol.
__________________
Reply With Quote
Reply

Bookmarks

Tags
data center, fire, hosting

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -6. The time now is 03:16 PM.
Copyright © 2001- 2013 Prison Talk Online
Powered by vBulletin® Version 3.7.4
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Website Design & Custom vBulletin Skins by: Relivo Media
Message Board Statistics