How Twitter Uses Redis to Scale - 105TB RAM, 39MM QPS, 10,000+ Instances 
Monday, September 8, 2014 at 9:05AM
Todd Hoff in Example

Yao Yue has worked on Twitter’s Cache team since 2010. She recently gave a really great talk: Scaling Redis at Twitter. It’s about Redis of course, but it's not just about Redis.

Yao has worked at Twitter for a few years. She's seen some things. She’s watched the growth of the cache service at Twitter explode from it being used by just one project to nearly a hundred projects using it. That's many thousands of machines, many clusters, and many terabytes of RAM.

It's clear from her talk that's she's coming from a place of real personal experience and that shines through in the practical way she explores issues. It's a talk well worth watching.

As you might expect, Twitter has a lot of cache.

Timeline Service for one datacenter using Hybrid List:
Use of BTree in one datacenter:

You'll learn more about BTree and Hybrid List later in the post.

A couple of points stood out:

With that in mind, let's learn more about how Redis is used at Twitter:

Why Redis?

Hybrid List

BTree

Cluster Management

Data Insight

Wish List for Redis

Lessons Learned

Related Articles

Article originally appeared on (http://highscalability.com/).
See website for complete article licensing information.