Building bigger, faster, more reliable websites.
Example
StubHub is an interesting architecture to take a look at because, as market makers for tickets, they are in a different business than we normally get to consider. StubHub is surprisingly large, growing at 20% a year, serving 800K complex pages per hour, selling 5 million tickets per year, and
hot links
It's HighScalability Time: * Quoteable Quotes: * @xinqiyang: Partition, replicate, index. Many efficiency and scalability problems are solved the same way. * @SnideLemon: Let's switch to a bottle of wine for economic scalability." -- the best justification for additional drinking ever * @cloudbees: "A whopping 57% of respondents
Example
This is a guest post by Rodrigo Guzman, CTO of iDoneThis, which makes status reporting happen at your company with the lightest possible touch. iDoneThis is a simple management application that emails your team at the end of every day to ask, "What'd you get done today?
Strategy
In Taming The Long Latency Tail we covered Luiz Barroso’s exploration of the long tail latency (some operations are really slow) problems generated by large fanout architectures (a request is composed of potentially thousands of other requests). You may have noticed there weren’t a lot of solutions. That’
Strategy
Ilya Grigorik has written another wonderful article lavishly detailing the extraordinary tactics Chrome employs to hide network latency from users: Chrome Networking: DNS Prefetch & TCP Preconnect. Ilya springs some surpising factoids on us, revealing how the web has slowed and super sized: * The size of an average page has
sponsored post
It's HighScalability Time: * 100PB : Facebook HDFS Cluster; One Trillion : Objects in S3 * Quotable quotes: * @mwinkle : Listening to NASA big data challenges at #hadoopSummit, the square kilometer array project will produce 700tb per second. TB. Per second. * @imrantech : #hadoopsummit @twitter - 400M tweets, 80-100TB per day * @r39132 : At Netflix
Strategy
The ever amazing slime mold is not the only way to solve complex compute problems without performing calculations. There is another: soap film. Unfortunately for soap film it isn’t nearly as photogenic as slime mold, all we get are boring looking pictures, but the underlying idea is still fascinating
humor
If you understand things best when they're formatted as a musical, this video is for you. It teaches the essentials of PostgreSQL, Riak, HBase, MongoDB, CouchDB, Neo4J and Redis in the style of My Fair Lady. And for a change, it's very SFW.
sponsored post
It's HighScalability Time: * 21TB : Tumblr relational data * Quotable Quotes: * @ajbaird: Scalability is not a "feature" tacked on at the end development. * @h_ingo: I like Doron's comparison: Build a MySQL scale-out cluster instead, then buy 2 Ferrari's with the money saved :-)
sponsored post
Who's Hiring? * Torbit is hiring! Care about performance? Care about making the internet faster and better? At Torbit we use lots of Golang, Node.js, JavaScript and PHP to solve big challenges. Fun and Informative Events * GigaSpaces Upcoming Events: webinar on Transactional Cross-Site Data Replication, CloudCamp lightning talk,
SDN
Ivan Pepelnjak (CCIE#1354 Emeritus) is Chief Technology Advisor at NIL Data Communications, author of numerous webinars and advanced networking books, and a prolific blogger. He’s focusing on data center and cloud networking, network virtualization, and scalable application design. OpenFlow is an interesting emerging networking technology appearing seemingly out
hot links
It's HighScalability Time: * Yottabytes : What NSA knows about US; 214ms : ping between San Jose and Fez; $42M : MongoDB is funding scale!; 20K : lines of THX sound code * @adrianco: My takeaway from the MongoDB talk at #gluecon is that Mongo is implementing eventual scalability in the next version * The