How Facebook moved 30 petabytes of Hadoop data – Old GigaOm
For anyone who didn’t know, Facebook is a huge Hadoop user, and it does some very cool things to stretch the open source big-data platform to meet Facebook’s unique needs. Today, it shared the latest of those innovations — moving its whopping 30-petabyte cluster from one data center to another. Facebook’s Paul Yang detailed the process on the Facebook Engineering page. The move was necessary becau
Facebook Messaging - HBase Comes of Age
Update: I want to thank Ben Black, Todd Lipcon, and Kelley Reynolds for pointing out the inaccuracies in the original post. I’ve gone through the references they provided and made corrections. Facebook, the data giant of the internet, recently unveiled a new messaging system. To be fair, I would normally ignore feature roll outs and marketing flimflam, but Facebook’s announcement is worthy of atte
Hadoop Usage at Facebook Dhruba Borthakur Facebook Data Infrastructure Team ApacheCon2008, New Orleans, 11/6/2008 Data Infrastructure Team ▪ Cross functional team of 11 members ▪ 5 people working in Hive development ▪ 2 people on Hadoop de
Hadoop Usage at Facebook Dhruba Borthakur Facebook Data Infrastructure Team ApacheCon2008, New Orleans, 11/6/2008 Data Infrastructure Team ▪ Cross functional team of 11 members ▪ 5 people working in Hive development ▪ 2 people on Hadoop development ▪ 2 people on Data Pipelines and Oracle Data Mart ▪ 1 Production Operations Hadoop Cluster Hardware ▪ Production cluster ▪ 2400 cores, 300 mach
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
