Strategy

3 Tips and Tools for Creating Reliable Billion Page View Web Services

General Chicken

Aug 8, 2012 — 1 min read

Amir Salihefendic, founder of Todoist and Wedoist, in How to create very reliable web services, has written an insightful post on strategies for creating reliable web services along with the tools needed to make it happen.

Realtime monitor everything. Create a clear picture of what's going on at any time both past and present. Keep a log of errors and key application metrics. Visualize response times and other metrics for every computer in your network. Tools: statsd, Graphite, Pingdom, Cacti, Nagios.
Be proactive. Don't optimize prematurely, but don't wait to optimize when in a crisis situation. Anticipate problems before they happen by monitoring and completely understanding your system. Think now about how to scale your system if load increases by several orders of magnitude.
Be notified when crashes happen. Use tools like Pingdom and crash_hound to send notifications when problems do occur.

While not secrets in any sense, the article is well written and has many useful details. Worth a look.

Kafka 101

This is a guest article by Stanislav Kozlovski, an Apache Kafka Committer. If you would like to connect with Stanislav, you can do so on Twitter and LinkedIn. Originally developed in LinkedIn during 2011, Apache Kafka is one of the most popular open-source Apache projects out there. So far it

Capturing A Billion Emo(j)i-ons

This blog post was written by Dedeepya Bonthu. This is a repost from her Medium article, approved by the author. In stadiums, sports fans love to express themselves by cheering for their favorite teams, holding up placards and team logos. Emoji’s allow fans at home to rapidly express themselves,

Brief History of Scaling Uber

This blog post was written by Josh Clemm, Senior Director of Engineering at Uber Eats. This is a repost from his LinkedIn article, approved by the author. On a cold evening in Paris in 2008, Travis Kalanick and Garrett Camp couldn't get a cab. That's when

Behind AWS S3’s Massive Scale

This is a guest article by Stanislav Kozlovski, an Apache Kafka Committer. If you would like to connect with Stanislav, you can do so on Twitter and LinkedIn. AWS S3 is a service every engineer is familiar with. It’s the service that popularized the notion of cold-storage to the

Read more

Kafka 101

Capturing A Billion Emo(j)i-ons

Brief History of Scaling Uber

Behind AWS S3’s Massive Scale