Building bigger, faster, more reliable websites.
This is a guest post by Ali Khajeh-Hosseini, Technical Lead at PlanForCloud.com. I read a recent blog post about TripAdvisor's experiment with AWS where they attempted to process 700K HTTP requests per minute on a replica of their live site. There was also an interesting blog post
This was the first architecture profile on HighScalability. IMHO LiveJournal was really the start of the openness on how to build stuff at scale, setting the whole industry off with an excellent role model. They wrote about their architecture, they open sourced their tools, they showed that success wasn'
sponsored post
Who's Hiring? * Zoosk is looking for a Data Center Operations Manager to scale our rapidly growing business. Are you ready to push the boundaries of technology driving data center operations for a top consumer web product? Join our team www.zoosk.com/careers. * Wiredrive is looking for a
As a little trip down memory lane this was the first post on High Scalability, an unbelievable five years ago. The purpose of the site as laid out here has not really changed at all. The goal is to help people do their jobs better and I think more times
Well, not exactly Fishin', I'll be on vacation starting today and I'll be back late November. I won't be posting anything new, so we'll all have a break. Disappointing, I know, but fear not, I will be posting some oldies for
hot links
It's HighScalability Time: * 1.5 Billion Pageviews: Etsy in September; 200 dedicated database servers: Tumblr * Quotable Quotes: * @rbranson : Datadog stays available where it counts (metrics injest) by using Cassandra, combined with an RDBMS for queries. Nice. * @jmhodges : Few engineers know what modern hw is capable of, in part,
Strategy
Rodrigo Campos shared some interesting benchmark results for AWS instances in the South America Region (São Paulo) and US East Region (North Virginia). He summarized the results in this thread on the Guerrilla Capacity Planning list: * The same instance type shows a different behavior depending on the region that it
Strategy
In a paper delivered at HotCloud '12 by a group from CMU and Intel Labs, Saving Cash by Using Less Cache (slides, pdf), they show it may be possible to use less DRAM under low load conditions to save on operational costs. There are some issues with this idea,
Example
A lot of people seem to passionately dislike the term NewSQL, or pretty much any newly coined term for that matter, but after watching Alex Lloyd, Senior Staff Software Engineer Google, give a great talk on Building Spanner, that’s the term that fits Spanner best. Spanner wraps the SQL
hot links
It's HighScalability Time: * @davilagrau: Youtube, GitHub,..., Are cloud services facing a entropic limit to scalability? * Async all the way down? The Tyranny of the Clock: The cost of logic and memory dominated Turing's thinking, but today, communication rather than logic should dominate our thinking. Clock-free design
Strategy
If you like the idea of exploiting market inconsistencies to lower your costs then you will love this paper and video from the Hot Cloud '12 conference: Exploiting Hardware Heterogeneity within the Same Instance Type of Amazon EC2. The conclusion is interesting and is a source of good guidance:
Strategy
In a really far ranging and insightful interview by Steve Peterson: Game Industry Legends: Rob Pardo, where the future of gaming is discussed, there was a section on how the cloud might be used in games. I know there are a lot of game developers in my audience, so I