hot links
It's HighScalability Time: * 100 Billion PVs/Week: Plenty of Fish; 695k TPS: Node.js & VoltDB; 131ms: Response from EC2 EU * Quotable quotes: * Markus Frind: Scaling is not very fun these days. * Mike Krieger: Scaling is like replacing all components on a car while driving it at 100
Product
This is guest post by Michael DeHaan (@laserllama), a software developer and architect, on Ansible, a simple deployment, model-driven configuration management, and command execution framework. I owe High Scalability a great deal of credit for the idea behind my latest software project. I was reading about how an older tool
Strategy
The adding jitter strategy was one of the most commented on techniques from 7 Years Of YouTube Scalability Lessons In 30 Minutes on HackerNews. Probably because it’s one of the emergent phenomena that you really can’t predict and is shocking when you see it in real life. Here’
Example
The fascination over Instagram continues and fortunately we have several new streams of information to feed the insanity. So consider this article an update to The Instagram Architecture Facebook Bought For A Cool Billion Dollars, based primarily on Scaling Instagram, a slide deck for an AirBnB tech talk given by
hot links
It's HighScalability Time: * 50 million in 50 days : Draw Something downloads; 40 million concurrent users : Skype * Key to making sensors ubiquitous is getting the BOM cost down. Here's a dream way of making that happen: Bye-Bye Batteries: Radio Waves as a Low-Power Source. “Silicon technology has
sponsored post
Who's Hiring? * Are you looking for people? Fun and Informative Events * Sign up for this free 30-minute webinar exploring how new technology can determine which ads have been seen by users and will discuss the C3 Metrics Labs analysis of over 2 billion impressions. Cool Products and Services
It's been a well kept secret, but you may have heard Facebook will Buy Photo-Sharing Service Instagram for $1 Billion. Just what is Facebook buying? Here's a quick gloss I did a little over a year ago on a presentation Instagram gave on their architecture. In
Strategy
Update: Organism without a brain creates external memories for navigation shows slime mold is even cooler than originally thought, storing a record of where it's been using slime: The authors conclude, the slime isn't just the mold's calling card. Instead, it's a
hot links
It's HighScalability Time: * Exascale Supercomputer: how IBM plans to understand data from a universe of light; 905 Billion Objects and 650,000 Requests/Second: S3; 64-cores: PostgreSQL shows linear read scalability; * Quotable quotes: * pkaler: Programming is hard. Scaling is harder. * @crucially: As far as I can tell, openstack
Strategy
This is a guest post by Matt Abrams (@abramsm), from Clearspring, discussing how they are able to accurately estimate the cardinality of sets with billions of distinct elements using surprisingly small data structures. Their servers receive well over 100 billion events per month. At Clearspring we like to count things.
Product
As it is said in the recent article "Google: Taming the Long Latency Tail - When More Machines Equals Worse Results" , latency variability has greater impact in larger scale clusters where a typical request is composed of multiple distributed/parallel requests. The overall response time dramatically decreases if
Example
Update: Here's the video of the talk. Erick Pickup, lead developer at YouPorn.com, presented their architecture in a talk titled Building a Website To Scale given at the ConFoo conference. As you might expect, YouPorn is a beast, streaming three full DVDs of video every second, handing