hot links
* What says 4th of July like Nathan's ultimate scalable hot dog eating contest? This totally requires a scale-up strategy. * Facebook at 60,000 servers and counting. * Deepak Singh has collected some impressive massive data stats on extreme Hadoop usage: Facebook: 36 PB of uncompressed data, 2250 machines, 23,
Paper
In the never ending quest to figure out how to do something useful with never ending streams of data, GraphLab: A New Framework For Parallel Machine Learning wants to go beyond low-level programming, MapReduce, and dataflow languages with a new parallel framework for ML (machine learning) which exploits the sparse
Product
What do you get when you take a SQL database and start a new implementation from scratch, taking advantage of the latest research and modern hardware? Mike Stonebraker, the sword wielding Johnny Appleseed of the database world, hopes you get something like his new database, VoltDB: a pure SQL, pure
hot links
* Royans Tharakan is blogging like a mad man at the Velocity Conference. Read a summary of many of the presentations on his blog. * Zuckerberg almost guarantees 1 billion Facebook users. And I almost believe him. * Northscale introduces Membase, a new distributed key-value NoSQL competitor featuring a memcache compatible interface, yet
Product
I met the CodeFutures folks, makers of dbShards, at Gluecon. They occupy an interesting niche in the database space, somewhere between NoSQL, which jettisons everything SQL, and high end analytics platforms that completely rewrite the backend while keeping a SQL facade. High concept: I think of dbShards as a sort
Example
Peter Alguacil at Pingdom wrote a HighScalability worthy article on Facebook's architecture: Exploring the software behind Facebook, the world’s largest site. It covers the challenges Facebook faces, the software Facebook uses, and the techniques Facebook uses to keep on scaling. Definitely worth a look.
sponsored post
Jobs * Sr. Operations Engineer and Web Operations Engineer at Etsy * Get Your High Scalability Fix at Digg * Huffington Post: Linux System Administrator Events * Velocity Web Performance and Operations Conference - Fast by Default * Social Developer Summit (HighScalability.com readers save 15% with discount code SDSHS) Sr. Operations Engineer at Etsy
Paper
The Declarative Imperative: Experiences and Conjectures in Distributed Logic is written by UC Berkeley's Joseph Hellerstein for a keynote speech he gave at PODS. The video version of the talk is here. You may have heard about Mr. Hellerstein through the Berkeley Orders Of Magnitude project (BOOM), whose
Forrester released their new wave report: The Forrester Wave™: Elastic Caching Platforms, Q2 2010 where they listed GigaSpaces, IBM, Oracle, and Terracotta as leading vendors in the field. In this post I'd like to take some time to explain what some of these terms mean, and why they’
hot links
* You're Doing it Wrong by Poul-Henning Kamp. Don't look so guilty, he's not talking about you know what, he's talking about writing high-performance server programs: Not just wrong as in not perfect, but wrong as in wasting half, or more, of your
Every system has a limit. Although most providers of web hosting services claim to provide "Unlimited", we all know that any web server has physical limits which is usually hard to scale up, especially without taking the machine offline. Most IT hosting companies use stand-alone servers to provide
Strategy
Aditya Agarwal, Director of Engineering at Facebook, gave an excellent Scale at Facebook talk that covers their architecture, but the talk is really more about how to scale an organization by preserving the best parts of its culture. The key take home of the talk is: You can get the