ask
We just released a social section to our iOS app several days ago and we are already facing scaling issues with the users' news feeds. We're basically using a Fan-out-on-write (push) model for the users' news feeds (posts of people and topics they follow) and we&
hot links
It's HighScalability Time: * TNW: On an average day, out of 30 trillion URLs on the web, Google crawls 20B web pages and now serves 100B searches every month. * Quotable Quotes: * @tapbot_paul: The 2 computers on the Curiosity rover are RAD750 based, they are approximately 1/10th the
Strategy
Amir Salihefendic, founder of Todoist and Wedoist, in How to create very reliable web services, has written an insightful post on strategies for creating reliable web services along with the tools needed to make it happen. * Realtime monitor everything. Create a clear picture of what's going on at
sponsored post
Who's Hiring? * Palantir Technologies is hiring a Software Engineer to develop our technologies for exploring huge information sets and presenting complex information to end-users. * Are you a seasoned systems admin? ground(ctrl) is looking for you! http://groundctrl.com/#!/jobs/senior-systems-administrator Fun and Informative Events * Percona announces MySQL
Paper
If you stayed up all night watching the life reaffirming Curiosity landing on Mars, then this paper, High-Performance Concurrency Control Mechanisms for Main-Memory Databases, has nothing to do with that at all, but it is an excellent look at how to use optimistic MVCC schemes to reduce lock overhead on
A very shy team of ex-Facebookers have created MemSQL, what they claim is the world's fastest database, and I'll be interviewing them on Tuesday. Are there any questions you would like to ask the MemSQL team? If so, please contact me or make a comment on
hot links
It's HighScalability Time: * Quotable Quotes: * Ross Tur: the tricks you learned to make things big are not the same tricks you can apply to make things infinite. * @gclaramunt: Son, I'm getting old, but let me tell you a secret: programming is hard, and high scalability and
Strategy
In the wake of the recent Amazon problems Ryan Lackey offers some practical first responder cloud survival advice: If you're a large site (particularly a PaaS) on AWS and care about availability, you need to have spare capacity in your region (using Reserve Instances, like Netflix does) to
AskHighScalability
Next week I'm going to have the pleasure of interviewing Gabriel Weinberg, founder of rebel search engine DuckDuckGo. Is there anything you would like to know about DuckDuckGo that I can ask Gabe? Please contact me or comment on this thread with your deepest desires.
Example
In update to Prismatic Architecture - Using Machine Learning on Social Networks to Figure Out What You Should Read on the Web, Jason Wolfe, even in the face of deadening fatigue from long nights spent getting their iPhone app out, has gallantly agreed to talk a little more about Primatic&
Example
This post on Prismatic’s Architecture is adapted from an email conversation with Prismatic programmer Jason Wolfe. What should you read on the web today? Any thoroughly modern person must solve this dilemma every day, usually using some occult process to divine what’s important in their many feeds: Twitter,
hot links
It's HighScalability Time: * Almost 1 Billion Users: Facebook; 30,000 connections across 94 locations: the Olympics Network; 2.5 quintillion: bytes of data created each day; 80K QPS: MemSQL. * In some early results Zencoder found EC2 was faster than GCE in their video transcoding tests, saying Google needs