Building bigger, faster, more reliable websites.
Example
Now that we have the C10K concurrent connection problem licked, how do we level up and support 10 million concurrent connections? Impossible you say. Nope, systems right now are delivering 10 million concurrent connections using techniques that are as radical as they may be unfamiliar. To learn how it’s
hot links
Hey, it's HighScalability time: (In Thailand, they figured out how to solve the age-old queuing problem!) * Nanoscale: Plants IM Using Nanoscale Sound Waves; 100 petabytes: CERN data storage * Quotable Quotes: * Geoff Arnold: Arguably all interesting advances in computer science and software engineering occur when a resource that was
framework
This is an email interview with Viktor Klang, Director of Engineering at Typesafe, on the Scala Futures model & Akka, both topics on which is he is immensely passionate and knowledgeable. How do you structure your application? That’s the question I explored in the article Beyond Threads And Callbacks.
humor
I read one of these poignantly humorous comics on Not Invented Here a while back and since I wasn't sure it was OK to repost I emailed asking for permission. Nada. Then I saw Martijn de Vrieze posted a collection of scalability comics from NIH and decided what
Strategy
Harish Ganesan CTO of 8KMiles has a very helpful blog, Cloud, Big Data and Mobile, where he shows a nice analytical bent which leads to a lot of practical advice and cost saving tips: 1. Use SQS Batch Requests to reduce the number of requests hitting SQS which saves costs.
Hey, it's HighScalability time: (Giant Hurricane on Saturn, here's one in New Orleans) * 1,966,080 cores: Time Warp synchronization protocol using up to 7.8M MPI tasks on 1,966,080 cores of the {Sequoia} Blue Gene/Q supercomputer system. 33 trillion events processed in
Example
In NoSQL: Past, Present, Future Eric Brewer has a particularly fine section on explaining the often hard to understand ideas of BASE (Basically Available, Soft State, Eventually Consistent), ACID (Atomicity, Consistency, Isolation, Durability), CAP (Consistency Availability, Partition Tolerance), in terms of a pernicious long standing myth about the sanctity of
sponsored post
Who's Hiring? * Want to build scalable systems that power the world's largest music streaming service? Spotify is looking for engineers for our backend infrastructure team. Apply now. * At Evernote our vision is to help the world remember everything. If you want to work in a face
This is a repost of part 2 (part 1) of an interview I did for the Boundary blog. Boundary: There’s another battle coming down the pike between Amazon (AWS) and Google (GCE). How should the CTO decide which one’s best? Hoff: Given that GCE is still closed to
hot links
Hey, it's HighScalability time: * 100 Billion - Neurons in The Human Brain, As Many Cells as Stars in the Milky Way; 10TB - Tumblr memcache * Quoteable Quotes: * @thoward3: OH: "We make scalability a possibility.. You know, we make 'scalapossibilty'. " * Tesla: When wireless is perfectly
Paper
Joe Armstrong is a co-inventor of Erlang and general all around renaissance software tinkerer as shown by his excellent work on writing a C Compiler and his voluminous work on GitHub. Given the success of Erlang it's probably no surprise that he wrote his thesis on the ground
Strategy
Solving problems while saving money is always a problem. In Nobody ever got fired for using Hadoop on a cluster they give some counter-intuitive advice by showing a big-memory server may provide better performance per dollar than a cluster: 1. For jobs where the input data is multi-terabyte or larger