Building bigger, faster, more reliable websites.
Strategy
Edward Capriolo has a really interesting article on his dramatic performance expanding experience of turning on compression for Cassandra. The idea: * Enabling compression shrunk 71GB of data down to 31GB, which caused more data to fit in RAM, which reduced disk IO to nearly nothing. * Compression means more data can
Example
This is the second guest post (part 1, part 3) of a series by Greg Lindahl, CTO of blekko, the spam free search engine. Previously, Greg was Founder and Distinguished Engineer at PathScale, at which he was the architect of the InfiniPath low-latency InfiniBand HCA, used to build tightly-coupled supercomputing
hot links
It's HighScalability Time: * 15 million 64 GB iPods every day: IBM on the Big Bang; Billions of msgs/day, 75Bn ops/day, 1.5M ops/sec peak. 250TB new data/mo and growing: Facebook HBase stats; 72 hours of video uploaded every minute: YouTube * Quotable Quotes: * @ammeep: Great
Strategy
This guest post is written by Josh Fraser, co-founder and CEO of Torbit. Torbit creates tools for measuring, analyzing and optimizing web performance. Did you know that 5% of the pageviews on Walmart.com take over 20 seconds to load? Walmart discovered this recently after adding real user measurement (RUM)
sponsored post
Who's Hiring? * Torbit is hiring! Care about performance? Care about making the internet faster and better? At Torbit we use lots of Golang, Node.js, JavaScript and PHP to solve big challenges. Fun and Informative Events * The DevOps PaaS Infusion Meetup NYC - Taking Mission-Critical Apps to the
Example
There has been an update on Pinterest: Pinterest growth driven by Amazon cloud scalability since our last post: A Short on the Pinterest Stack for Handling 3+ Million Users. With Pinterest we see a story very similar to that of Instagram. Huge growth, lots of users, lots of data, with
hot links
It's HighScalability Time: * 42 Billion: Netflix API Requests/Month * Quotable quotes: * @commonlisp: Ideas from the talk: In Haskell laziness + thunks + garbage collection (GC) impede multicore scalability. Parallel GC is crucial. * @Bulldozer0: Global state is the enemy of scalability; not only in software, but in governance. * If you'
Strategy
In Zen And The Art Of Scaling - A Koan And Epigram Approach, Russell Sullivan offered an interesting conjecture: there are 20 classic bottlenecks. This sounds suspiciously like the idea that there only 20 basic story plots. And depending on how you chunkify things, it may be true, but in
Strategy
My impression of DynamoDB before attending a Amazon DynamoDB for Developers talk is that it’s the usual quality service produced by Amazon: simple, fast, scalable, geographically redundant, expensive enough to make you think twice about using it, and delightfully NoOp. After the talk my impression has become more nuanced.
hot links
It's HighScalability Time: * 2.5M : Erlang Concurrent Connections; 20 Billion : Urban Airship Push Notifications. * @agentdero: "You go to production with the code you have, not the code you wish you had" - Devops Rumsfeld * @PatrickMcFadin: After talking to a lot of big #aws customers tonight, the
Paper
If you are a normal human being and find the Paxos protocol confusing, then this paper, Paxos Made Moderately Complex, is a great find. Robbert van Renesse from Cornell University has written a clear and well written paper with excellent explanations. The Abstract: For anybody who has ever tried to
Strategy
A consequence of Service Oriented Architectures is the burning need to provide services at scale. The architecture that has evolved to satisfy these requirements is a little known technique called the Cell Architecture. A Cell Architecture is based on the idea that massive scale requires parallelization and parallelization requires components