Strategy
The idea is most jobs are small. Researchers found 82% of jobs on Facebook's cluster were less than 10 tasks. Clusters have a median utilization of under 20%. And since small jobs are particularly sensitive to stragglers the audacious solution is to proactively launch clones of a job
hot links
Hey, it's HighScalability time: A CT scanner without its clothes on. Sexy. * 255Tbps: all of the internet’s traffic on a single fiber; 864 million: daily Facebook users * Quotable Quotes: * @chr1sa: "No dominant platform-level software has emerged in the last 10 years in closed-source, proprietary form” * @joegravett:
sponsored post
Who's Hiring? * Apple has multiple openings. Changing the world is all in a day's work at Apple. Imagine what you could do here. * Site Reliability Engineer. As a member of the Apple Pay SRE team, you’re expected to not just find the issues, but to
Strategy
This is a guest repost written by Andrew Harmel-Law on his real world experiences with Microservices. The original article can be found here. It’s reached the point where it’s even a cliche to state “there’s a lot written about Microservices these days.” But despite this, here’s
hot links
Hey, it's HighScalability time: This is an ultrasound powered brain implant! (65nm GP CMOS technology, high speed, low power (100 µW)) * 70: percentage of the worlds transactions processed using COBOL. * Quotable Quotes: * John Siracusa: Apple has shown that it wants to succeed more than it fears being seen
Paper
With Reactive Systems becoming the new old hotness, it will help to have a thorough grounding in the Actor Model. Here's a good start. Carl Hewitt in Actor Model of Computation: Scalable Robust Information Systems gives a very thorough and relatively concise explanation of the Actor model. Here&
Strategy
We've learned mobile is different. In If You're Programming A Cell Phone Like A Server You're Doing It Wrong we learned programming for a mobile platform is its own specialty. In How Facebook Makes Mobile Work At Scale For All Phones, On All Screens,
hot links
Hey, it's HighScalability time: What could this be? Swarms of drones painting 3D light sculptures against the night sky! * Quotable Quotes: * Visnja Zeljeznjak: Steve Jobs' product pricing formula: cost of materials x 3 + 33% * Benedict Evans: We now have over 2bn iOS and Android devices on earth,
Strategy
Using EBS has lots of advantages--reliability, snapshotting, resizing--but overcoming the performance problems by using Provisioned IOPS is expensive. Swrve, an integrated marketing and A/B testing and optimization platform for mobile apps, did something clever. They are using the c3.xlarge EC2 instances, that have two 40GB SSD devices per
sponsored post
Who's Hiring? * Apple has multiple openings. Changing the world is all in a day's work at Apple. Imagine what you could do here. * Senior Engineer: Mobile Services. The Emerging Technologies/Mobile Services team is looking for a proactive and hardworking software engineer to join our team.
Example
How would you build a chat service that needed to handle 7.5 million concurrent players, 27 million daily players, 11K messages per second, and 1 billion events per server, per day? What could generate so much traffic? A game of course. League of Legends. League of Legends is a
hot links
Hey, it's HighScalability time: Social climber: Instagram explorer scales to new heights in New York. * 11 billion: world population in 2100; 10 petabytes: Size of Netflix data warehouse on S3; $600 Billion: the loss when a trader can't type; 3.2: 0-60 mph time of probably