hot links
Submitted for your scaling pleasure: * Facebook confirms 750 million users, sharing 4 billion items daily; Yahoo: 42,000 Hadoop nodes storing 180-200 petabytes; Formspring hits 25 million users. * Zynga's Cadir Lee: It’s not the amount of hardware that matters. It’s the architecture of the application. You
Strategy
For a long epoch there was a strategy of scaling up by making ever bigger super computers. I had the pleasure of programming on a few large massively multi-processor machines from SGI and DEC. Beautiful, highly specialized machines that were very expensive. These met the double-tap extinction event of Moore&
Strategy
In How to take advantage of Redis just adding it to your stack Salvatore 'antirez' Sanfilippo shows how to solve some common problems in Redis by taking advantage of its unique data structure handling capabilities. Common Redis primitives like LPUSH, and LTRIM, and LREM are used to accomplish
sponsored post
Who's Hiring? * TripAdvisor is Hiring Engineers at all Levels: Scalable Web Engineering Program. To apply for our Scalable Web Engineering Program, visit http://www.tripadvisor.com/careers/webprogram * Are you a scalability expert? eHarmony is looking for Senior Java Engineers to help implement and scale our Matching compatibility
Strategy
If you are an insect, don't work at TripAdvisor, specialization is out. One of the most commented on strategies from the TripAdvisor architecture article is their rather opinionated take on the role of engineers in the organization. Typically engineers live in a box. They are specialized, they do
hot links
Submitted for your scaling pleasure: * Twitterers tweet 200 million tweets a day. Popular topics are eclectic, ranging from Swine Flu to Rebecca Black. Twitter has a really cool video on the global flow of tweets in the world. Worth watching. It looks like a rainbow arcing across the northern hemisphere.
Strategy
Like a digital SWAT team that implodes the wrong door on a raid, the FBI seized multiple racks of computers from DigitalOne, these racks host websites from many clients that just happened to be in the same racks as whomever they are investigating. Downed sites include Instapaper, Curbed Network, and
sponsored post
Who's Hiring? * BioWare Austin is looking for a Performance Test Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin. * BioWare Austin is looking for a Contract Build Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin.
Example
This is a guest post by Andy Gelfond, VP of Engineering for TripAdvisor. Andy has been with TripAdvisor for six and a half years, wrote a lot of code in the earlier days, and has been building and running a first class engineering and operations team that is responsible for
hot links
Submitted for your scaling pleasure: * Achievements: * Watson uses 10,000's of watts, the computer between the ears uses 20. With only 200 million pages and 2TB of data, Watson is BigInsights, not BigData. * That Google is pretty big: 1 billion unique monthly visitors * tweetimages: We peaked at 22m
Strategy
Planning your next buildout and thinking SSDs are still far in the future? Still too expensive, too low density. Hard disks are cheap, familiar, and store lots of stuff. In this short and entertaining video Wikia's Artur Bergman wants to change your mind about SSDs. SSDs are for
I recently came across a TPC-C benchmark results held on MySQL based RDS databases. You can see it here. I think the results may bring light to many questions concerning MySQL scalability in general and RDS scalability in particular. (For disclosure, I'm working for ScaleBase where we run