advertise
Monday
Sep172007

Blog: Adding Simplicity by Dan Pritchett

Dan has genuine insight into building software and large scale scalable systems in particular. You'll always learn something interesting reading his blog.

A Quick Hit of What's Inside

Inverting the Reliability Stack, In Support of Non-Stop Software, Chaotic Perspectives, Latency Exists, Cope!, A Real eBay Architect Analyzes Part 3, Avoiding Two Phase Commit, Redux

Click to read more ...

Sunday
Sep162007

What software runs on this site?

It's pretty slick! olla

Click to read more ...

Saturday
Sep152007

The Role of Memory within Web 2.0 Architectures and Deployments

Although I have a basic working knowledge of memory, SSDs and the like, I am not technical...I have never developed or deployed a system. I was exposed to ram-disks years ago, when their expense limited their use to very small files or DB applications. I am looking to "get current" on what role memory plays in curremt WEB 2.0 design and deployments. How is memory commonly used to remove latency and accelerate performance in typical Web 2.0 architectures? What role can memory play in massive scale-out implementations? Are there such a thing as memory "best practives"? If memory were cheap, would that significantly change the way systems are designed and deployed? What commercial and open source products that use memory are used, what are the benefits and trade-offs? Can anyone suggest what sources - people, books, papers, products - I might look into to gain a practical understanding of this topic?

Click to read more ...

Thursday
Sep132007

Design Preparations for Scaling

Hi there, what do you think is crucial in the code designing of a scalable site? How does one prepare for webfarms and clusters (e.g. in PHP)? Thanks, Stephan

Click to read more ...

Wednesday
Sep122007

Technology behind mediatemple grid service 

Anyone knows what's behind this service? http://www.mediatemple.net/webhosting/gs/ thanks!

Click to read more ...

Monday
Sep102007

Blog: Scalable Web Architectures by Royans Tharakan

Royans' scalability blog and his main blog are excellent sources of scalability information. Take a look.

A Quick Hit of What's Inside

Sharding: Different from Partitioning and Federation ?, Adventures of scaling eins.de, Session, state and scalability

Click to read more ...

Monday
Sep102007

Blog: Esoteric Curio by Theo Schlossnagle

Theo Schlossnagle is the author of Scalable Internet Architecture and the funder of OmniTI , a global leader in Internet technology services that power the World Wide Web and email. As you might imagine Theo frequently posts on interesting topics for the scalable website builder.

A Quick Hit of What's Inside

Partitioning vs. Federation vs. Sharding, PostgreSQL warm standby on ZFS crack, Scalability vs. Performance: it isn't a battle

Click to read more ...

Monday
Sep102007

Book Store

Monday
Sep102007

Is there a difference between partitioning and federation and sharding?

Unlike Theo Schlossnagle, author of Scalable Internet Architectures, I am not a stickler for semantics because I have an unswerving faith in the ultimate unknowability of the world as experienced by others. That's why it is Theo who bravely tackles the differences in his informative blog post Partitioning vs. Federation vs. Sharding. Royans Tharakan also talks about it on his blog. Is there a difference and does it really matter to all our intrepid scalable website builders? Generally whatever Theo says is probably close to the truth. Yet, in my mind I think of partitioning as a basic level category and federation and sharding as more specific (subordinate) instances of partitioning. And partitioning is a more specific instance of the more more general (superordinate) category divide-and-conquer. Which isn't a useful way to think about the topic at all. So, let's say federation is like Star Trek. The Vulcans, Klingons, and Humans live in very separate policy domains, but they each pledge to work together to make sure Captain Kirk always gets the girl. And sharding is like AJAX, a great marketing term for stuff that may have already existed, but has taken on a new useful life on its own. And that new useful life is that there are very specific examples of how sharding works, how it has been successful for existing web sites, and how you can create your scalable web site use shards. Federation and partitioning are far more nebulous less pragmatic concepts, so I am more than happy to AJAXify sharding into the popular lexicon :-) Related Articles:

  • An Unorthodox Approach to Database Design : The Coming of the Shard.

    Click to read more ...

  • Sunday
    Sep092007

    Clustering Solution

    Hi, I'm interested in peoples thoughts on the best choice for a database clustering solution. I have a database that is mostly varchars and numbers that doesn't store any binary data at all. It's used at about 70% read and 30% writes - though we're using memcached at the moment so it's not really hit that hard. We're currently using mysql with m/cluster, but are interested in a new solution. Possible candidate so far are unicluster (which doesn't seem mature yet.) or DRBD. Had anyone had a similar experience and can make any suggestions? Thanks

    Click to read more ...