Building bigger, faster, more reliable websites.
hot links
Hey, it's HighScalability time: Stunning Multi-Wavelength Image Of The Solar Atmosphere. * 4x: amount spent by Facebook users * Quotable Quotes: * Facebook: Facebook's average data set for CF has 100 billion ratings, more than a billion users, and millions of items. In comparison, the well-known Netflix Prize recommender
Paper
Underutilization and segregation are the classic strategies for ensuring resources are available when work absolutely must get done. Keep a database on its own server so when the load spikes another VM or high priority thread can't interfere with RAM, power, disk, or CPU access. And when you
Strategy
A little bit of follow up... In How Can We Build Better Complex Systems? Containers, Microservices, And Continuous Delivery I had a question about what Mary Poppendieck meant when she talked about poking complex systems. InfoQ interviewed Mary & Tom Poppendieck and found out the answer: Mary & Tom Poppendieck:
Strategy
Wait, you don't want 100% uptime? Who said such a crazy thing? Risk taker Urs Hölzle, senior VP for technical infrastructure, in Google's Infrastructure Chief Talks SDN: Whenever you try something new, there are going to be problems with it....We were willing to take the
Strategy
How should you go about structuring your project? We have two general paradigms that I'll characterize as flowing from the Etsy coaching tree, emphasising the monolith, and from the Netflix coaching tree, emphasizing microservices. This is of course an over simplification, but it's for instructional purposes
hot links
Hey, it's HighScalability time: Just imagine. 0-100 mph in 1.2 seconds. Astronaut's view from the Dragon spacecraft. * $850B: mobile web market in 2018; 107: unicorns; 3.2 billion: # of people on the Internet; 10^82: atoms in the observable universe * Quotable Quotes: * @cloud_opinion: appropriate
Strategy
Jean Dagenais published a great response on a mechanical-sympathy thread to Gil Tene's article, The Black Magic Of Systematically Reducing Linux OS Jitter. It's full of helpful tools for tracking down jitter problems. I apologize for the incomplete attribution. I did not find a web presence
sponsored post
Who's Hiring? * Make Tumblr fast, reliable and available for hundreds of millions of visitors and tens of millions of users. As a Site Reliability Engineer you are a software developer with a love of highly performant, fault-tolerant, massively distributed systems. Apply here now! * At Scalyr, we're
Example
This is a guest post by dhilipsiva, Full-Stack & DevOps Engineer at Appknox. Appknox helps detect and fix security loopholes in mobile applications. Securing your app is as simple as submitting your store link. We upload your app, scan for security vulnerabilities, and report the results. What's notable
hot links
Hey, it's HighScalability time: Where is the World Brain? San Fernando marshes in Spain (by Cristobal Serrano) * 569TB: 500px total data transfer per month; 82% faster: elite athletes' brains; billions and millions: Facebook's graph store read and write load; 1.3 billion: daily Pinterest spam
Database
This is a guest post by Cihan Biyikoglu, Director of Product Management at Couchbase. Question: A few million people are out looking for a setup to efficiently live and interact. What is the most optimized architecture they can use? 1. Build one giant high-rise for everyone, 2. Build many single-family
Paper
It's amazing what you can accomplish these days on a single machine using SSDs and smart design. In the paper FlashGraph: Processing Billion-Node Graphs on an Array of Commodity SSDs they: demonstrate that FlashGraph is able to process graphs with billions of vertices and hundreds of billions of