Building bigger, faster, more reliable websites.
sponsored post
Who's Hiring? * Aconex is looking for a Systems Engineer in San Bruno. Please apply here. * Hadapt brings high-performance SQL to Hadoop, and is looking for a systems engineer to join this fast-growing company. Please apply at http://www.hadapt.com/jobs. * MathWorks Looking for Multiple, Full-time Scaling Experts.
AWS
This is a guest post by Frédéric Faure (architect at Ysance), you can follow him on twitter. Urbandive is an immersive view service launched by the French YellowPages which allows you to travel in cities in France thanks to a 360° view. Urbandive focuses on providing high definition pictures and
hot links
Submitted for your scaling pleasure: * Achievements: * Every day, Amazon Web Services adds enough new capacity to support all of Amazon.com’s global infrastructure through the company’s first 5 years, when it was $2.7 billion annual revenue. From Cloud Computing Is Driving Infrastructure Innovation by James Hamilton. Where&
GAE
With the Google IO Developer Conference completed there are dozens and dozens of information packed videos now available. While you won't get any of the nifty free swag the attendees rake in, it's great of Google to make these videos available so quickly after the conference.
Strategy
There has been a lot of speculation over how Apple's iCloud would work. With the Apple Worldwide Developers Conference keynotes having just completed, we finally learned the truth. We can handle it. They made some interesting and cost effective architecture choices that preserved the value of their devices
hot links
Submitted for your scaling pleasure: * Twitter indexes an average of 2,200 TPS (peek is 4x that) while serving 18,000 QPS (1.6B queries per day). eBay serves 2 billion page views every day requiring more than 75 billion database requests. * Quotable Quotes: * Infrastructure is adaptation --Kenneth Wright, referencing
Strategy
Who hasn't cursed their network for being slow while waiting for that annoying little hour glass of pain to release all its grains of sand? But what's really going on? Is your network really slow? PacketPushers Show 45 – Arista – EOS Network Software Architecture has a good
Paper
As part of Dr. Indranil Gupta's CS 525 Spring 2011 Advanced Distributed Systems class, he has collected an incredible list of resources on distributed systems. His research group is also doing some interesting work. The various topics include: Before there Were Clouds, Cloud Computing, P2P Systems, Basic Distributed
sponsored post
Who's Hiring? * Animoto is building a Systems (DevOps) Team. Please apply here. * Clustrix Inc. - Learn more about Clustrix's interpretation of NewSQL. Please apply here. * deviantART is looking for Network and Systems Operations Engineer. Please apply here. * Hadapt brings high-performance SQL to Hadoop, and is looking
hot links
Submitted for your scaling pleasure: * Good idea: Open The Index And Speed Up The Internet. SmugMug estimates 50% of their CPU is spent serving crawler robots. Having a common meta-data repository wouldn't prevent search engines from having their own special sauce. Then the problem becomes one of syncing
videos
Surge is a conference put on by OmniTI targeting practical Scalability matters. OmniTI specializes in helping people solve their scalability problems, as is only natural, as it was founded by Theo Schlossnagle, author of the canonical Scalable Internet Architectures. Now that Surge 2011 is on the horizon, they've
Example
The folks at Evernote were kind enough to write up an overview of their architecture in a post titled Architectural Digest. Dave Engberg describes their approach to networking, sharding, user storage, search, and some other custom services. Evernote is a cool application, partially realizing Vannevar Bush's amazing vision