hot links
It's HighScalability Time: * Yottabytes : What NSA knows about US; 214ms : ping between San Jose and Fez; $42M : MongoDB is funding scale!; 20K : lines of THX sound code * @adrianco: My takeaway from the MongoDB talk at #gluecon is that Mongo is implementing eventual scalability in the next version * The
Strategy
Edward Capriolo has a really interesting article on his dramatic performance expanding experience of turning on compression for Cassandra. The idea: * Enabling compression shrunk 71GB of data down to 31GB, which caused more data to fit in RAM, which reduced disk IO to nearly nothing. * Compression means more data can
Example
This is the second guest post (part 1, part 3) of a series by Greg Lindahl, CTO of blekko, the spam free search engine. Previously, Greg was Founder and Distinguished Engineer at PathScale, at which he was the architect of the InfiniPath low-latency InfiniBand HCA, used to build tightly-coupled supercomputing
hot links
It's HighScalability Time: * 15 million 64 GB iPods every day: IBM on the Big Bang; Billions of msgs/day, 75Bn ops/day, 1.5M ops/sec peak. 250TB new data/mo and growing: Facebook HBase stats; 72 hours of video uploaded every minute: YouTube * Quotable Quotes: * @ammeep: Great
nosql
Major social networking platforms like Facebook and Twitter have developed their own architectures for handling the need for real-time analytics on huge amounts of data. However, not every company has the need or resources to build their own Twitter-like solution. In this example we have taken the same Twitter/Facebook-like
Strategy
This guest post is written by Josh Fraser, co-founder and CEO of Torbit. Torbit creates tools for measuring, analyzing and optimizing web performance. Did you know that 5% of the pageviews on Walmart.com take over 20 seconds to load? Walmart discovered this recently after adding real user measurement (RUM)
sponsored post
Who's Hiring? * Torbit is hiring! Care about performance? Care about making the internet faster and better? At Torbit we use lots of Golang, Node.js, JavaScript and PHP to solve big challenges. Fun and Informative Events * The DevOps PaaS Infusion Meetup NYC - Taking Mission-Critical Apps to the
Example
There has been an update on Pinterest: Pinterest growth driven by Amazon cloud scalability since our last post: A Short on the Pinterest Stack for Handling 3+ Million Users. With Pinterest we see a story very similar to that of Instagram. Huge growth, lots of users, lots of data, with
hot links
It's HighScalability Time: * 42 Billion: Netflix API Requests/Month * Quotable quotes: * @commonlisp: Ideas from the talk: In Haskell laziness + thunks + garbage collection (GC) impede multicore scalability. Parallel GC is crucial. * @Bulldozer0: Global state is the enemy of scalability; not only in software, but in governance. * If you'
Strategy
In Zen And The Art Of Scaling - A Koan And Epigram Approach, Russell Sullivan offered an interesting conjecture: there are 20 classic bottlenecks. This sounds suspiciously like the idea that there only 20 basic story plots. And depending on how you chunkify things, it may be true, but in
Strategy
My impression of DynamoDB before attending a Amazon DynamoDB for Developers talk is that it’s the usual quality service produced by Amazon: simple, fast, scalable, geographically redundant, expensive enough to make you think twice about using it, and delightfully NoOp. After the talk my impression has become more nuanced.
hot links
It's HighScalability Time: * 2.5M : Erlang Concurrent Connections; 20 Billion : Urban Airship Push Notifications. * @agentdero: "You go to production with the code you have, not the code you wish you had" - Devops Rumsfeld * @PatrickMcFadin: After talking to a lot of big #aws customers tonight, the