hot links
It's HighScalability Time: * @5h15h: Walmart took 40years to get their data warehouse at 400 terabytes. Facebook probably generates that every 4 days * Should your database failover automatically or wait for the guiding hands of a helpful human? Jeremy Zawodny in Handling Database Failover at Craigslist says Craigslist and
Strategy
Nothing shows how much software architectures have changed than the intelligent scheduling of computation over differently priced compute resources. This isn't just a false economy either. Vimeo saves up to 50% on their video transcoding bill by intelligently playing the spot, reserved, and on-demand markets. If you are
Strategy
If you are looking for an excellent overview of general architecture principles then take a look at Will Larson's Introduction to Architecting Systems for Scale. Based on his experiences at Yahoo! and Digg, Will covers key concepts in some depth. A quick gloss on the building blocks: 1.
sponsored post
Who's Hiring? * The New York Times is seeking a developer focused on infrastructure to join its newsroom development team. Read the full description here and send resumes to chadas@nytimes.com. * FiftyThree, the company behind the award-winning iPad app Paper, is looking for a {Backend || DevOps} Engineer to
Strategy
Facebook made quite a splash when they released their native iOS app, not because of their app per se, but because of their conclusion that their biggest mistake was betting on HTML5, so they had to go native. As you might imagine this was a bit like telling a Great
hot links
It's HighScalability Time: * Serves 4 billion hours of video each month, has 425M gmail users, and has 100PB of active data: Google; 340,000+ cores across 300 data centers to >10k scientists, archiving 15PB / yr: Open Science Grid * Quotable Quotes: * Chris Travers: MySQL is what you get
Strategy
This is a guest post from Per Buer, founder and CEO of Varnish Software, provider of Varnish Cache, an open source web application accelerator freely available at varnish-cache.org. Varnish powers a lot of really big websites worldwide. We at Varnish Software are all about speed. Varnish Cache is built
This is an intuitive look at large data sizes By Julian Bunn in Globally Interconnected Object Databases. Bytes(8 bits) * 0.1 bytes: A binary decision * 1 byte: A single character * 10 bytes: A single word * 100 bytes: A telegram OR A punched card Kilobyte (1000 bytes) * 1 Kilobyte: A
Product
My name is Russell Sullivan, I am the author of AlchemyDB: a highly flexible NoSQL/SQL/DocumentStore/GraphDB-datastore built on top of redis. I have spent the last several years trying to find a way to sanely house multiple datastore-genres under one roof while (almost paradoxically) pushing performance to its
hot links
It's HighScalability Time: * Quotable Quotes: * Where did all the supercomputers go? Inside Intel. * @Jacattell: I love the smell of high scalability in the morning :-) * @nkohari: Post on HN about GitHub scalability. Top comment? “…someone wasted valuable time making the dashboard look so pretty” * Evolution of SoundCloud’s
sponsored post
Who's Hiring? * FiftyThree, the company behind the award-winning iPad app Paper, is looking for a {Backend || DevOps} Engineer to help us build our next great product: a service to "bring ideas together". http://www.fiftythree.com/jobs * New Relic is looking for a Java Scalability Engineer
Strategy
One consequence of IT standardization and commodification has been Google’s datacenter is the computer view of the world. In that view all compute resources (memory, CPU, storage) are fungible. They are interchangeable and location independent, individual computers lose identity and become just a part of a service. Thwarting that