Engineering Rapleaf - Goodbye MapReduce, Hello Cascading
For engineers by engineersWe have been doing a lot of batch processing with Hadoop MapReduce lately, and we quickly realized how painful it can be to write MapReduce jobs by hand. Some parts of our workflow require up to TEN MapReduce jobs to execute in sequence, requiring a lot of hand-coordination of intermediate data and execution order. Additionally, anyone who has done really complex MapReduc
Yahoo Pig and Google Sawzall
It is hard to tell from the limited documentation available, but the Pig project at Yahoo Research seems to have a lot in common with Sawzall at Google. Both are high level programming languages targeting massively parallel processing across huge clusters. From the Pig project page:We are creating infrastructure to support ad-hoc analysis of very large data sets. Parallel processing is the name of
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Pig Latin – High Level Data Processing with Elastic MapReduce | Amazon Web Services
Pig Tutorial
Pig Cookbook
Redirect
Yahoo, Hadoop, and Pig Latin
