advertise
Tuesday
Jul052011

Sponsored Post: TripAdvisor, eHarmony, NoSQL Now!, Surge, BioWare, Tungsten, deviantART, Aconex, Hadapt, Mathworks, AppDynamics, ScaleOut, Membase, CloudSigma, ManageEngine, Site24x7

Who's Hiring?

  • TripAdvisor is Hiring Engineers at all Levels: Scalable Web Engineering Program. To apply for our Scalable Web Engineering Program, visit http://www.tripadvisor.com/careers/webprogram
  • Are you a scalability expert? eHarmony is looking for Senior Java Engineers to help implement and scale our Matching compatibility systems. Please visit: http://tinyurl.com/3g8mxks.
  • BioWare Austin is looking for a Performance Test Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin.
  • BioWare Austin is looking for a Contract Build Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin.
  • deviantART is looking for Network and Systems Operations Engineer. Please apply here.
  • Aconex is looking for a Systems Engineer in San Bruno. Please apply here.
  • Hadapt brings high-performance SQL to Hadoop, and is looking for a systems engineer to join this fast-growing company. Please apply at http://www.hadapt.com/jobs.
  • MathWorks Looking for Multiple, Full-time Scaling Experts. Apply now: http://matlab.my/lVmunb 

Fun and Informative Events

  • NoSQL Now! is a new conference covering the dynamic field of NoSQL technologies. August 23-25 in San Jose. For more information please visit: http://www.NoSQLNow.com
  • Surge 2011: The Scalability and Performance Conference. Surge is a chance to identify emerging trends and meet the architects behind established technologies. Early Bird Registration.
  • Join our webinar as we introduce Tungsten Enterprise Summer '11 Edition with improved usability, performance and ease of management for MySQL and PostgreSQL clusters.
  • Couchbase is having a Special Offer for Apache CouchDB Developer Training! http://www.couchbase.com/couchdb-training/portland-june-2011

Cool Products and Services

For a longer description of each sponsor, please read more below...

Click to read more ...

Friday
Jul012011

TripAdvisor Strategy: No Architects, Engineers Work Across the Entire Stack

If you are an insect, don't work at TripAdvisor, specialization is out. One of the most commented on strategies from the TripAdvisor architecture article is their rather opinionated take on the role of engineers in the organization.

Typically engineers live in a box. They are specialized, they do database work and not much else, and they just do programming, not much else. TripAdvisor takes the road less traveled:

  • Engineers work across entire stack - HTML, CSS, JS, Java, scripting. If you do not know something, you learn it. The only thing that gets in the way of delivering your project is you, as you are expected to work at all levels - design, code, test, monitoring, CSS, JS, Java, SQL, scripting.
  • We do not have "architects."  At TripAdvisor, if you design something, your code it, and if you code it you test it. Engineers who do not like to go outside their comfort zone, or who feel certain work is "beneath" them will simply get in the way.

A radical take for an established organization. We've seen companies where backend engineers are also responsible for front-line site support, but I don't recall, other than for startups obviously, where engineers have such breadth and depth of responsibility. It's not right or wrong, but something outside-the-box to consider, especially if you are an Agile shop.

Friday
Jul012011

Stuff The Internet Says On Scalability For July 1, 2011

Submitted for your scaling pleasure: 

  • Twitterers tweet 200 million tweets a day. Popular topics are eclectic, ranging from Swine Flu to Rebecca Black. Twitter has a really cool video on the global flow of tweets in the world. Worth watching. It looks like a rainbow arcing across the northern hemisphere.
  • Amazon Cloud Now Stores 339 Billion Objects, more than doubling last years volume. 
  • Quotable quotes for independence Alex:
    • n8foo: My fav part about the new #AWS pricing announcement - 500TB is the level where they say 'contact us'.
    • stevedekorte: Are the folks advocating FP for scalability unaware of the Von Neumann bottleneck?
    • lhazlewood: I don't think I've ever had a Love/Hate relationship like I've had with NoSQL. It's all awesome. And it all sucks.
  • Free is good says Amazon, No Inbound Data Transfer Fees and slightly lower outbound fees. Will Amazon make up for this with voume? Maybe S3 sales (which are not cheaper)? it's true, most sites upload little data compared to their outbound traffic, but for some use cases it's a real win, email, scraper bots, chat, video, and backup.
For lots more Stuff the Internet said, please read below...

Click to read more ...

Wednesday
Jun292011

Second Hand Seizure : A New Cause of Site Death

Like a digital SWAT team that implodes the wrong door on a raid, the FBI seized multiple racks of computers from DigitalOne, these racks host websites from many clients that just happened to be in the same racks as whomever they are investigating. Downed sites include Instapaper, Curbed Network, and Pinboard. With the density of servers these days many 1000s of sites could easily have been effected.

Sites like Pinboard were victims by association, they did not inhale. This is an association sites have no control over. On a shared hosting service, you have no control over your fellow VM mates. In a cloud or a managed service, you have no control over which racks your servers are in. So like second hand smoke, you get the disease by random association. There's something inherently unfair about that.

A comment by illumin8 shows just how Darth insidious this process can be:

Click to read more ...

Tuesday
Jun282011

Sponsored Post: Surge, BioWare, Tungsten, deviantART, Aconex, Hadapt, Mathworks, AppDynamics, ScaleOut, Membase, CloudSigma, ManageEngine, Site24x7

Who's Hiring?

  • BioWare Austin is looking for a Performance Test Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin.
  • BioWare Austin is looking for a Contract Build Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin.
  • deviantART is looking for Network and Systems Operations Engineer. Please apply here.
  • Aconex is looking for a Systems Engineer in San Bruno. Please apply here.
  • Hadapt brings high-performance SQL to Hadoop, and is looking for a systems engineer to join this fast-growing company. Please apply at http://www.hadapt.com/jobs.
  • MathWorks Looking for Multiple, Full-time Scaling Experts. Apply now: http://matlab.my/lVmunb 

Fun and Informative Events

Cool Products and Services

For a longer description of each sponsor, please read more below...

Click to read more ...

Monday
Jun272011

TripAdvisor Architecture - 40M Visitors, 200M Dynamic Page Views, 30TB Data

This is a guest post by Andy Gelfond, VP of Engineering for TripAdvisor. Andy has been with TripAdvisor for six and a half years, wrote a lot of code in the earlier days, and has been building and running a first class engineering and operations team that is responsible for the worlds largest travel site. There's an update for this article at An Epic TripAdvisor Update: Why Not Run On The Cloud? The Grand Experiment

For TripAdvisor, scalability is woven into our organization on many levels - data center, software architecture, development/deployment/operations, and, most importantly, within the culture and organization. It is not enough to have a scalable data center, or a scalable software architecture. The process of designing, coding, testing, and deploying code also needs to be scalable. All of this starts with hiring and a culture and an organization that values and supports a distributed, fast, and effective development and operation of a complex and highly scalable consumer web site.

Stats as of 6/2011

Click to read more ...

Friday
Jun242011

Stuff The Internet Says On Scalability For June 24, 2011

Submitted for your scaling pleasure: 

Wednesday
Jun222011

It's the Fraking IOPS - 1 SSD is 44,000 IOPS, Hard Drive is 180

Planning your next buildout and thinking SSDs are still far in the future? Still too expensive, too low density. Hard disks are cheap, familiar, and store lots of stuff. In this short and entertaining video Wikia's Artur Bergman wants to change your mind about SSDs. SSDs are for today, get with the math already.

Here's Artur's logic:

Click to read more ...

Tuesday
Jun212011

Running TPC-C on MySQL/RDS

I recently came across a TPC-C benchmark results held on MySQL based RDS databases. You can see it here. I think the results may bring light to many questions concerning MySQL scalability in general and RDS scalability in particular. (For disclosure, I'm working for ScaleBase where we run an internal scale out TPC-C benchmark these days, and will publish results soon).

TPC-C

TPC-C is a standard database benchmark, used to measure databases. The database vendors invest big bucks in running this test, and showing off which database is faster, and can scale better.

It is a write intensive test, so it doesn’t necessarily reflect the behavior of the database in your application. But it does give some very important insights on what you can expect from your database under heavy load.

The Benchmark Process

Click to read more ...

Monday
Jun202011

35+ Use Cases for Choosing Your Next NoSQL Database

We've asked What The Heck Are You Actually Using NoSQL For?. We've asked 101 Questions To Ask When Considering A NoSQL Database. We've even had a webinar What Should I Do? Choosing SQL, NoSQL or Both for Scalable Web Applications.

Now we get to the point of considering use cases and which systems might be appropriate for those use cases.

What are your options?

Click to read more ...