hot links
* Disqus - Scaling the Worlds Largest Django App. Interesting overview of a commenting system with 75 million comments and 250 million visitors. Lots of good details on how they partition their database, testing, continuous integration, feature switches, caching, delayed signals, and more. * Things I learnt tracking a billion events in
hot links
With summer almost gone, it's time to fall into some good links... * Hibari - distributed, fault tolerant, highly available key-value store written in Erlang. In this video Scott Lystig Fritchie gives a very good overview of the newest key-value store. * Tweets of Gold * lenidot: with 12 staff, @tumblr
hot links
Lots of good links this week... * Membase, powering Farmville's 500k operations *per second*. Of course, some people contend they could do this on their old Vic-20, but this is a useful, vigorous discussion thread on Reddit. * Tweets of Gold: * kbsingh: I dont understand why some developers think its
hot links
* Ezra Zygmuntowicz in a heart warming account of his 4 Years at Engine Yard, has concluded in his experience that: the true future of cloud computing for developers is to not think about servers at all. It is now time to focus on the Application and new levels of abstraction
hot links
* Twitter Sees Its 20 Billionth Tweet writes Marshall Kirkpatrick of ReadWriteWeb. * Startups die for not having customers, so STOP thinking about how to scale. Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb...concentrate on marketing...concentrate on
hot links
* Jeremy Zawodny, while performing data alchemy in the dungeons of Craigslist, stored 1,250,000,000 Key/Value Pairs in Redis on a 32GB Machine. * Data sorting world record: 1 terabyte, 1 minute. The system has 52 computer nodes, each node is a commodity server with two quad-core processors, 24
hot links
And by hot I also mean temperature. Summer has arrived. It's sizzling here in Silicon Valley. Thank you air conditioning! * Scale the web by appointing a Crawler Czar? Tom Foremski has the idea that Google should open up their index so sites wouldn't have to endure
hot links
* Facebook serves 3 billion Like buttons a day says VentureBeat. * CloudScaling reports: Rumor Mill: Google EC2 Competitor Coming in 2010? It looks like GAE for PaaS and an EC2 clone for IaaS. * Tweets of gold: * alandipert: scalability is a drug * seldo: Scalability lesson #23: if any part of your system
hot links
* What says 4th of July like Nathan's ultimate scalable hot dog eating contest? This totally requires a scale-up strategy. * Facebook at 60,000 servers and counting. * Deepak Singh has collected some impressive massive data stats on extreme Hadoop usage: Facebook: 36 PB of uncompressed data, 2250 machines, 23,
hot links
* Royans Tharakan is blogging like a mad man at the Velocity Conference. Read a summary of many of the presentations on his blog. * Zuckerberg almost guarantees 1 billion Facebook users. And I almost believe him. * Northscale introduces Membase, a new distributed key-value NoSQL competitor featuring a memcache compatible interface, yet
hot links
* You're Doing it Wrong by Poul-Henning Kamp. Don't look so guilty, he's not talking about you know what, he's talking about writing high-performance server programs: Not just wrong as in not perfect, but wrong as in wasting half, or more, of your
hot links
* How Big is a Yottabyte? Not so big that the NSA can't hope to store it says CrunchGear: There are a thousand gigabytes in a terabyte, a thousand terabytes in a petabyte, a thousand petabytes in an exabyte, a thousand exabytes in a zettabyte, and a thousand zettabytes