The entire internet in one box. Sound unbelievable? Not so. Today, Sun launched a single Sun Modular Datacenter (SunMD), housed in our Santa Clara datacenter, that contains the Wayback Machine from Internet Archive. IA has captured the web in the form of pages, graphics, videos, java scripts and more for the past 12 years! Yes, the past twelve years. Just imagine, all that "creative" stuff you posted on the web through your career (and yes you know those pictures and videos I'm talking about) have been captured by the Internet Archive crawlers. I even checked one of the sites I had created in 1996 for a non profit called Child Quest International, Inc. It was just as I had built it (boy my graphics were archaic then).
I got involved with the project when Greg Papadopolous (our CTO) and David Douglas (our CSO) donated a SunMD to Brewster Kahle, Digital Librarian, Director and Co-Founder of Internet Archive. We then worked out a way to host that container in our Santa Clara, CA Datacenter. We decided to place it in the courtyard between the two main datacenter buildings. We bored through the wall to the plant, tapped the chilled water, piped to the UPS/GenSet and wired the internet access. Then we poured the concrete and craned in the container.
Finally it was filled up with 4.5 petabytes worth of Sun X4500 storage (thumpers). In just a few months, we had successfully deployed this container based solution into our site. Amazingly fast, and cost effective when you think of the depreciation schedule you can apply to owned buildings. For us it's 25 years. We had already prepped for two more containers at the same time. $90k of additional pipework and concrete over 25 years is peanuts. The second container is already in place (right next to the IA SunMD) and will be used for the Chill Off 2 (CO2) testing starting April 1st!
I was bummed that I wasn't able to participate in the event, but I was traveling around Europe doing other Data Center stuff. But my team was there to answer questions and tour attendees through the SunMD and the surrounding datacenter complex that it sits in. I'd like to thank a few folks on my team for making this project happen. Mike Ryan (Mechnical/Electrical), Serena Devito (Networking & Technical support), Brian Day (Coordination) and Alex Menchaca (Technical Support). Without them, it could not have pulled this off as quickly as it was.
Watch Sun's rich interactive, multi-media web story on the Internet Archive here. Michelle Sadowski did an incredible job driving this project and this multi-media product really shows it.
See more photos of the event from Jefferey Stein, Chairman of the IT History Society, on his shutterfly page.
Readthe success Story here.
And, you can only imagine how much press came out of this. Here are some of the articles.
1. Sun upgrades Internet Archive to 4.5 petabytes - vnunet.com, Iain Thomson; March 26, 2009
2. Wayback Machine stowed in shipping container - Computing (UK), Dave Bailey; March 26, 2009
3. Sun store the Internet in a Box - Slash Gear, Chris Davies; March 26, 2009
4. Sun Packs 150 Billion Web Pages into Meat Locker - The Register, Cate Metz; March 25, 2009
5. Sun Crams the Entire Internet in a Box - GigaOM, Stacey Higginbotham; March 25, 2009
6. All the Web is Stored on One Sun Data Center - San Francisco Chronicle, Deborah Gage & Ryan Kim; March 25, 2009
7. Internet Archive, Sun Create ‘Living History’ of Web - San Jose Business Journal, Staff; March 25, 2009
8. The Internet Archive’s Wayback Machine Gets a New Data Center - Computerworld, Lucas Mearian; March 25, 2009
9. InfoStor - Sun and Internet Archive Store Internet in a Box - Recent Announcements from: March 25, 2009 Infostor, Staff; March 25, 2009
10. Internet Archive Upgrades Wayback Machine - PC World, Lucas Mearian; March 22, 2009
11. Huge Internet archive data centre opens - The Inquirer, Nick Farrell; March 20, 2009
12. New Digs for the Wayback Machine - IT Business Edge, Arthur Cole: March 20, 2009
13. Internet Archive to Open Data Center - Web Hosting Industry News, Justin Lee; March 20, 2009
14. Internet Archive to unveil massive Wayback Machine data center - Computerworld, Lucas Mearian; March 19, 2009
15. Data Storage Slideshow: Internet Archive Gets a Place in the Sun (Portable Data Center) - eWEEK, Chris Preimesberger; March 26, 2009