Click through for a talk about how Twitter scales out timelines. I found a couple of points really interesting
- most timeline writes fanout to all a users followers, except for the biggest users (many millions of followers)
- all timelines are kept in memory in a Redis cluster
Checkout High Scalability for more notes.