High Scalability (Page 121)

Twitter by the Numbers - 460,000 New Accounts and 140 Million Tweets Per Day

Twitter has taken some hits lately, but they are still pumping out the tweets and adding massive numbers of new users. Here are some numbers they just published, hot off the analytics engine: Tweets * 3 years, 2 months and 1 day. The time it took from the first Tweet to

Strategy

6 Lessons from Dropbox - One Million Files Saved Every 15 minutes

Dropbox saves one million files every 15 minutes, more tweets than even Twitterers tweet. That mind blowing statistic was revealed by Rian Hunter, a Dropbox Engineer, in his presentation How Dropbox Did It and How Python Helped at PyCon 2011. The first part of the presentation is some Dropbox lore,

Strategy

Google and Netflix Strategy: Use Partial Responses to Reduce Request Sizes

This strategy targets reducing the amount of protocol data in packets by sending only the attributes that are needed. Google calls this Partial Response and Partial Update. Netflix posted about adopting this strategy in their recent Netflix API redesign. We've seen previously how Netflix improved performance by creating

gigaspaces

Productivity vs. Control tradeoffs in PaaS

Gartner published recently an interesting paper: Productivity vs. Control: Cloud Application Platforms Must Split to Win . (The paper requires registration.) The paper does a pretty good job covering the evolution that is taking place in the PaaS market toward a more open platform and compares between the two main categories:

Example

Medialets Architecture - Defeating the Daunting Mobile Device Data Deluge

Mobile developers have a huge scaling problem ahead: doing something useful with massive continuous streams of telemetry data from millions and millions of devices. This is a really good problem to have. It means smartphone sales are finally fulfilling their destiny: slaughtering PCs in the sales arena. And it also

hot links

Stuff The Internet Says On Scalability For March 4, 2011

Submitted for your reading pleasure on this beautifully blue and sunny Friday... * @Werner: Each day #AWS adds enough computing muscle to power one whole Amazon.com circa 2000, when it was a $2.8 billion business http://wv.ly/gMr8LQ * Building servers to rule in hell. Datacenters spend a lot

Example

Stack Overflow Architecture Update - Now at 95 Million Page Views a Month

A lot has happened since my first article on the Stack Overflow Architecture. Contrary to the theme of that last article, which lavished attention on Stack Overflow's dedication to a scale-up strategy, Stack Overflow has both grown up and out in the last few years. Stack Overflow has

A Practical Guide to Varnish - Why Varnish Matters

This is a guest post by Jeff Su from Factual. What is Varnish? Varnish is an open source, high performance http accelerator that sits in front of a web stack and caches pages. This caching layer is very configurable and can be used for both static and dynamic content. One

Strategy

Strategy: Eliminate Unnecessary SQL

MySQL Expert Ronald Bradford explains how one key way to improve the scalability of a MySQL server, and undoubtedly nearly every other server, is to eliminate unnecessary SQL, saying the most efficient way to improve an SQL statement is to eliminate it: The MySQL kernel can only physically process a

Strategy

This stuff isn't taught, you learn it bit by bit as you solve each problem.

"For the things we have to learn before we can do them, we learn by doing them." -- Aristotle A really nice Internet moment happened in the HackerNews thread Disqus: Scaling the World’s Largest Django Application, when David Kitchen crafted an awesome response to a question about

Latest

Sponsored Post: Schooner, deviantART, ScaleOut, aiCache, WAPT, Karmasphere, Kabam, Newrelic, Cloudkick, Membase, Joyent, CloudSigma, ManageEngine, Site24x7

Twitter by the Numbers - 460,000 New Accounts and 140 Million Tweets Per Day

6 Lessons from Dropbox - One Million Files Saved Every 15 minutes

Google and Netflix Strategy: Use Partial Responses to Reduce Request Sizes

Medialets Architecture - Defeating the Daunting Mobile Device Data Deluge

Stuff The Internet Says On Scalability For March 4, 2011

Stack Overflow Architecture Update - Now at 95 Million Page Views a Month

Sponsored Post: ScaleOut, aiCache, WAPT, Karmasphere, Kabam, Opera Solutions, Newrelic, Cloudkick, Membase, Joyent, CloudSigma, ManageEngine, Site24x7

A Practical Guide to Varnish - Why Varnish Matters

Strategy: Eliminate Unnecessary SQL

This stuff isn't taught, you learn it bit by bit as you solve each problem.