Building bigger, faster, more reliable websites.
Example
The fascination over Instagram continues and fortunately we have several new streams of information to feed the insanity. So consider this article an update to The Instagram Architecture Facebook Bought For A Cool Billion Dollars, based primarily on Scaling Instagram, a slide deck for an AirBnB tech talk given by
hot links
It's HighScalability Time: * 50 million in 50 days : Draw Something downloads; 40 million concurrent users : Skype * Key to making sensors ubiquitous is getting the BOM cost down. Here's a dream way of making that happen: Bye-Bye Batteries: Radio Waves as a Low-Power Source. “Silicon technology has
sponsored post
Who's Hiring? * Are you looking for people? Fun and Informative Events * Sign up for this free 30-minute webinar exploring how new technology can determine which ads have been seen by users and will discuss the C3 Metrics Labs analysis of over 2 billion impressions. Cool Products and Services
It's been a well kept secret, but you may have heard Facebook will Buy Photo-Sharing Service Instagram for $1 Billion. Just what is Facebook buying? Here's a quick gloss I did a little over a year ago on a presentation Instagram gave on their architecture. In
Strategy
Update: Organism without a brain creates external memories for navigation shows slime mold is even cooler than originally thought, storing a record of where it's been using slime: The authors conclude, the slime isn't just the mold's calling card. Instead, it's a
hot links
It's HighScalability Time: * Exascale Supercomputer: how IBM plans to understand data from a universe of light; 905 Billion Objects and 650,000 Requests/Second: S3; 64-cores: PostgreSQL shows linear read scalability; * Quotable quotes: * pkaler: Programming is hard. Scaling is harder. * @crucially: As far as I can tell, openstack
Strategy
This is a guest post by Matt Abrams (@abramsm), from Clearspring, discussing how they are able to accurately estimate the cardinality of sets with billions of distinct elements using surprisingly small data structures. Their servers receive well over 100 billion events per month. At Clearspring we like to count things.
Example
Update: Here's the video of the talk. Erick Pickup, lead developer at YouPorn.com, presented their architecture in a talk titled Building a Website To Scale given at the ConFoo conference. As you might expect, YouPorn is a beast, streaming three full DVDs of video every second, handing
hot links
Choosy Mothers Choose HighScalability: * Quotable quotes: * @itarradellas: "Revolutions in science have often been preceded by revolutions in measurement" * @jasongorman: Use dependency injection, not Spring. Use event-driven, asynchronous I/O, not Node.js. Use MVC, not http://ASP.NET MVC etc etc * @bernardgolden: #netflix uses most aggressive #aws reservation
Strategy
Martin Thompson wrote a really interesting article on the beneficial performance impact of taking advantage of Processor Affinity: The interesting thing I've observed is that the unpinned test will follow a step function of unpredictable performance. Across many runs I've seen different patterns but all similar
sponsored post
Who's Hiring? * Nokia's Cloud Computing, Operations and Development Group is hiring! Check out: http://devops.nokia.com. CCOD designs, builds, manages and scales Nokia’s cloud computing. * ConnecTV is a start up looking for a DevOps & System Administration Leader to help build a revolutionary new
Example
If you started out building a dating site and instead ended up building a video sharing site (YouTube) that handles 4 billion views a day, then it’s just possible you learned something along the way. And indeed, Mike Solomon, one of the original engineers at YouTube, did learn a