advertise
« 7 Life Saving Scalability Defenses Against Load Monster Attacks | Main | 42 Monster Problems that Attack as Loads Increase »
Friday
Mar012013

Stuff The Internet Says On Scalability For February 29, 2013

Hey, it's HighScalability time: 

Unfortunately with Delicious still down access to all my lovingly curated links is out. But the show must go on...

  • Quotable Quotes:
    • @muratdemirbas: In the cloudcomputing webservices domain antifragility= elastic scalability + network effect
    • @SQLPerfTips: More hardware won't solve response time problems. Proper indexing does.
    • Stefan Boberg: The fastest I/O request is the one you dont'!
    • Alan Kay: The key in making great and growable systems is much more to design how its modules communicate rather than what their internal properties and behaviors should be.
    • antirez: One thing, more than everything else, keeps me focused while programming: never interrupt the flow.
  • The NPR apps team shows How to build a news app that never goes down and costs you practically nothing. Two servers provide high reliability at very little cost. Even on election night only one server was required. They use Flask, Jinja, LESS, JST, Bootstrap, Fab, git, Python, Node.js, and S3 to serve static content. Excellent description of their low cost, low overhead process.
  • Spotify sings In praise of “boring” technology: More often than not, the right tool for the job is piece of software that has been around for some time, with proven success. One example would be writing a backend service in Java or Python instead of Go or Node.JS. Another example would be storing data in MySQL or PostgreSQL instead of MongoDB or Riak. < They are looking into Zookeeper to replace DNS for more dynamic configuration and Cassandra to handle distributed writes.
  • The End of Scalability?: We are likely to see continued improvement in IaaS and PaaS solutions that auto-scale and perform to such a degree that most applications will not need to worry about scaling because of user traffic. 
  • Slides for the Strata Conference are up. Videos in a few weeks.
  • The Google Cloud Tech Talk. A good general introduction to cloud computing by Anthony Voellm and a useful peek into the Google Cloud Platform.
  • #hangops is a informal hangout dedicated to talking about all things DevOps. It makes up in practical industry IQ for what it lacks in production values. You also may be interested in DevOps Cafe
  • Scaling the Pipeline. Stefan Boberg looks at the incredibly complex process of making a modern game by showing how assets are handled and then working backwards through the pipe. Huge amounts of data combine with huge numbers of collaborators. Fascinating.
  • CloudantGeo looks interesting. simple JSON over HTTP, automatic sharding, and spatio-temporal queries.
  • There are various scalability meetups around the world you may be interested in: Seattle, Toronto, for example.
  • colmmacc recommends keeping everything static in Apache so threads aren't created and deleted during load: MaxClients         1000 MinSpareThreads    1000 MaxSpareThreads    1000   ThreadsPerChild      25
  • Lots of good discussion around MarkedUp's Cassandra, Hive, and Hadoop: How We Picked Our Analytics Stack: Cassandra, Hive, and Hadoop ended up being the right tools for us at this stage, but we only arrived at that conclusion after actually doing live acceptance tests and performance tests.
  • Netflix announces EVCache: Distributed in-memory datastore for Cloud. It's clustered caching combined with zone aware goodness. Netflix uses it to cache user Users Taste, Movie Viewing History, Queue, Rating, etc. 
  • Chef seems to be racking up the industry wins: Facebook, EC2, Zynga, and CERN.

Reader Comments (4)

Feb 29th, I love it!

In honor of Windows Azure I presume!

March 1, 2013 | Unregistered Commenterpetermtate

I've been working more with Chef so I'd like to see it gain even more marketshare, but a few of those examples you give of chef wins appear to be puppet wins instead.

Luke Kanies from Puppet Labs, makers of Puppet and competing with Opscode in the infrastructure automation area, ... names Zynga with 50.000 servers and an upcoming deployment at the CERN nuclear physics research lab in Switzerland with up to 300,000 servers to prove his point.

March 1, 2013 | Unregistered CommenterDave

Wow, the date for this post looks odd. It says Feb 29, 2013.

March 1, 2013 | Unregistered CommenterShashi

Dave, I think both Opscode and PuppetLabs spread misinformation about Zynga and CERN. I've seen multiple presentations from both camps that claim that these 2 clients are switching from one product to another. :/
I think the truth is that these companies are large enough that they have installs of both Chef and Puppet to do various thigns.

On a related note, Ansible is better than Chef or Puppet. :p

March 2, 2013 | Registered Commentermxx

PostPost a New Comment

Enter your information below to add a new comment.
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>