Actor
This is a guest repost by Ron Pressler, the founder and CEO of Parallel Universe, a Y Combinator company building advanced middleware for real-time applications. Little’s Law helps us determine the maximum request rate a server can handle. When we apply it, we find that the dominating factor limiting
sponsored post
Who's Hiring? * Apple is hiring for multiple positions. Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. * Senior Server Side Engineer. The Emerging Technology team is looking for a highly motivated, detail-oriented, energetic individual
Example
Raymond Blum leads a team of Site Reliability Engineers charged with keeping Google's data secret and keeping it safe. Of course Google would never say how much data this actually is, but from comments it seems that it is not yet a yottabyte, but is many exabytes in
Hey, it's HighScalability time: Largest battle ever on Eve Online. 2,000 players. $200K in damage. Awesome pics. * teaspoon of soil: hosts up to a billion bacteria spread among a million species. * Quotable Quotes: * Vivek Prakash: The problem of scaling always takes a toll on you. * @jcsalterego: See
Strategy
Monitor, monitor, monitor. That's the advice every startup gives once they reach a certain size. But can you ever monitor enough? If you are Bitly and everyone will complain when you are down, probably not. Here are 10 Things We Forgot to Monitor from Bitly, along with good
Example
This is a guest post by Eric Czech, Chief Architect at Next Big Sound, talks about some unique approaches taken to solving scalability challenges in music analytics. Tracking online activity is hardly a new idea, but doing it for the entire music industry isn't easy. Half a billion
hot links
Hey, it's HighScalability time: Gorgeous image from Scientific American's Your Brain by the Numbers * Quotable Quotes: * @jezhumble: Google does everything off trunk despite 10k devs across 40 offices. * @KentLangley: "in 2016. When it goes online, the SKA is expected to produce 700 terabytes of data
If you were going to design a next generation Internet at the physical layer that routes around the current Internet, what would it look like? What should it do? How should it work? Who should own it? How should it be paid for? How would you access it? It has
sponsored post
Who's Hiring? * Apple is hiring for multiple positions. Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. * Sr. Security Software Developer. We are looking for an excellent programmer who's done extensive security
Strategy
Stardog makes a commercial graph database that is a great example of what can be accomplished with a scale-up strategy on BigIron. In a recent article StarDog described how they made their new 2.1 release insanely scalable, improving query scalability by about 3 orders of magnitude and it can
hot links
Hey, it's HighScalability time: From the stunning Scale of the Universe - Interactive Flash Animation * $7 trillion: US spend on patrolling oil sea-lanes; 82 billion: files served by MaxCDN in 5 months * Quotable Quotes: * @StephenFleming: "Money doesn’t solve scaling problems, but the actual solutions to scaling
Product
I don't know about you, but when I first learned about Redis my initial thought was wow, why hasn't anyone done this before? My next thought was why put this functionality in a separate process? Why not just embed it in your own server code and