Paper
Erasure codes are one of those seemingly magical mathematical creations that with the developments described in the paper XORing Elephants: Novel Erasure Codes for Big Data, are set to replace triple replication as the data storage protection mechanism of choice. The result says Robin Harris (StorageMojo) in an excellent article,
Example
This is a guest post by Yelp's Jim Blomo. Jim manages a growing data mining team that uses Hadoop, mrjob, and oddjob to process TBs of data. Before Yelp, he built infrastructure for startups and Amazon. Check out his upcoming talk at OSCON 2013 on Building a Cloud
sponsored post
Who's Hiring? * An exciting opportunity for a Software Engineer to join Apple's Messaging Services team. We build the cloud systems that power some of the busiest applications in the world. You'll have the opportunity to explore a wide range of technologies, developing the server
This is a guest post by Ali Khajeh-Hosseini, Technical Lead at PlanForCloud. The original article was published on their site. With 29 cloud price reductions I thought it would be interesting to see how the bottom line would change compared to an article we published last year. The result is
hot links
Hey, it's HighScalability time: * 1 trillion messages/day: Facebook's pub-sub; 4ms: Google Fiber last mile latency * Quotable Quotes: * @blueben: Just like general computing, Google observes that faster networks beget richer content rather than a faster user experience. #velocityconf * @unixdaemon: All of the big wins in performance
Paper
The paper MegaPipe: A New Programming Interface for Scalable Network I/O (video, slides) hits the common theme that if you want to go faster you need a better car design, not just a better driver. So that's why the authors started with a clean-slate and designed a
Example
You know your product is doing well when most of your early blog posts deal with the status of the waiting list of hundreds of thousands of users eagerly waiting to download your product. That's the enviable position Mailbox, a free mobile email management app, found themselves early
hot links
Hey, it's HighScalability time: (Steve Gibson on Security Now with a plausible analysis of the tech behind PRISM) * 27 billion: WhatsApp messages per day * Quotable Quotes: * Richard Feinman: If Bill Gates walks into a bar, on average, everybody in the bar is a millionaire. * @giltene: Financial Programmers get
Strategy
"It’s all a numbers game – the dirty little secret of scalable systems" Martin Thompson is a High Performance Computing Specialist with a real mission to teach programmers how to understand the innards of modern computing systems. He has many talks and classes (listed below) on caches, buffers,
sponsored post
Who's Hiring? * An exciting opportunity for a Software Engineer to join Apple's Messaging Services team. We build the cloud systems that power some of the busiest applications in the world. You'll have the opportunity to explore a wide range of technologies, developing the server
Strategy
In the moral realm there may be 7 deadly sins, but scalability maven Sean Hull has come up with Five More Things Deadly to Scalability that when added to his earlier 5 Things That are Toxic to Scalability, make for a numerologically satisfying 10 sins again scalability: 1. Slow Disk
hot links
Hey, it's HighScalability time: (Ever feel like everyone has already climbed your Everest?) * Trillion Particles, 120,000 cores, and 350 TBs: Lessons Learned From a Hero I/O Run on Hopper * Quotable Quotes: * @PenLlawen: @spolsky In my time as a scalability engineer, I’ve seen plenty of cases