Building a complete Tweet index

Today, we are pleased to announce that Twitter now indexes every public Tweet since 2006. Since that first simple Tweet over eight years ago, hundreds of billions of Tweets have captured everyday human experiences and major historical events. Our search engine excelled at surfacing breaking news and events in real time, and our search index infrastructure reflected this strong emphasis on recency.

[pcod]

shardingが時間とハッシュの2次元になっている/ストレージが最適化してある/rebuildが並列化されているのがポイントっぽい

[tmatsuu]

atode

[ogijun]

あとで読む

[daisukebe]

Twitterの検索システム。あらためて読んでるけど全ツイート検索可能になるまで試行錯誤の繰り返しで面白いな

[kasumani]

Building a complete Tweet index Today, we are pleased to announce that Twitter now indexes every public Tweet since 2006. Since that first simple Tweet over eight years ago, hundreds of billions of Tweets have captured everyday human experiences and major historical events. Tags: from Pocket Novembe

[kimutansk]

時間とハッシュ2軸での分割を行うことで、過去のデータを修正しなくて済むデータストア方式。あとRAMが間にあわないのでSSD向けにカーネルチューニングして間にあわせたと。

[k_enoki]

海なうとかで調べればいつでも水着写真が見られるわけだ。

[kksg]

やばい