hot links
Submitted for your scaling pleasure: * Twitter indexes an average of 2,200 TPS (peek is 4x that) while serving 18,000 QPS (1.6B queries per day). eBay serves 2 billion page views every day requiring more than 75 billion database requests. * Quotable Quotes: * Infrastructure is adaptation --Kenneth Wright, referencing
Strategy
Who hasn't cursed their network for being slow while waiting for that annoying little hour glass of pain to release all its grains of sand? But what's really going on? Is your network really slow? PacketPushers Show 45 – Arista – EOS Network Software Architecture has a good
Paper
As part of Dr. Indranil Gupta's CS 525 Spring 2011 Advanced Distributed Systems class, he has collected an incredible list of resources on distributed systems. His research group is also doing some interesting work. The various topics include: Before there Were Clouds, Cloud Computing, P2P Systems, Basic Distributed
sponsored post
Who's Hiring? * Animoto is building a Systems (DevOps) Team. Please apply here. * Clustrix Inc. - Learn more about Clustrix's interpretation of NewSQL. Please apply here. * deviantART is looking for Network and Systems Operations Engineer. Please apply here. * Hadapt brings high-performance SQL to Hadoop, and is looking
hot links
Submitted for your scaling pleasure: * Good idea: Open The Index And Speed Up The Internet. SmugMug estimates 50% of their CPU is spent serving crawler robots. Having a common meta-data repository wouldn't prevent search engines from having their own special sauce. Then the problem becomes one of syncing
videos
Surge is a conference put on by OmniTI targeting practical Scalability matters. OmniTI specializes in helping people solve their scalability problems, as is only natural, as it was founded by Theo Schlossnagle, author of the canonical Scalable Internet Architectures. Now that Surge 2011 is on the horizon, they've
Example
The folks at Evernote were kind enough to write up an overview of their architecture in a post titled Architectural Digest. Dave Engberg describes their approach to networking, sharding, user storage, search, and some other custom services. Evernote is a cool application, partially realizing Vannevar Bush's amazing vision
hot links
Submitted for your reading pleasure on this beautiful morning: * Group Decision Making in Honey Bee Swarms. In distributed computing systems nodes reach a quorum when deciding what to do as a group. It turns out bees also use quorum logic when deciding on where to nest! Bees do it a
Strategy
Release early and often. A/B testing. Creating a landing page and buying ads on AdSense. All are ways of providing quick feedback in order to validate an idea. If you are like Zynga, with 250 million active users a month, how do you cost effectively prove out a game
Example
What should the architecture of your scalable, real-time, highly available service look like? There are as many options as there are developers, but if you are looking for a general template, this architecture as described by Prashant Malik, Facebook's lead for the Messages back end team, in Scaling
Who's Hiring? * Animoto is building a Systems (DevOps) Team. Please apply here. * Clustrix Inc. - Learn more about Clustrix's interpretation of NewSQL. Please apply here. * deviantART is looking for Network and Systems Operations Engineer. Please apply here. * Hadapt brings high-performance SQL to Hadoop, and is looking
The AWS East Region outage showed all of us the importance of running our apps and databases across multiple Amazon regions (or multiple cloud providers). In this post, I’ll try to explain how to build a MySQL (or Amazon RDS) redundant site. For simplicity, we create a passive redundant