Progressive Data Solutions - Hadoop on Rails
A few months ago, I wrote an article about using Ruby with Hadoop, and more specifically, the Amazon Elastic MapReduce (EMR) service. I hope some of you found that article helpful. I figured it was time to post a follow-up - using Rails with Hadoop. Much of my work over the past few months has been building a system to efficiently store, process, and display large amounts of log data. Naturally I
Ex-Google Man Sells Search Genius to Rest of World
MC Srivas spent nearly two years at Google, running one of its search infrastructure teams, and in the summer of 2009, he left the company to found a startup that aims to take the ideas behind Google’s top-secret infrastructure and deliver them to the average business. The startup is called MapR, and like so many other outfits, it offer a product based on Hadoop, the open source version of the Goo
Cloudera Blog
In an era where artificial intelligence (AI) is reshaping enterprises across the globe—be it in healthcare, finance, or manufacturing—it’s hard to overstate the transformation that AI has had on businesses, regardless of industry or size. At Cloudera, we recognize the urgent need for bold steps to harness this potential and dramatically accelerate the time to […] Read blog post
第1回 Amazon Elastic MapReduceを使う準備をする | gihyo.jp
Amazon Elastic MapReduceとは 昨今、バッチ処理にHadoopを活用する事例が話題になっています。その中でも特筆すべきなのは、分散処理技術であるMapReduceです。しかし、MapReduceを実際に使うには、数台から数100台のサーバを用意し、Hadoopのセットアップもしなければなりません。そのようなサーバ構築・管理、セットアップの手間を無くし、すぐ使えるのがAmazon Web Service（AWS）のElastic MapReduce（EMR）です。 図1 Amazon Elastic MapReduce AWS、MapReduceの説明は多くの書籍、ブログなどを参照してください。また、EMRを使用するには、まずAWSのアカウントを作っておく必要がありますが、その手順も割愛させていただきます。本連載ではEMRの使い方、気をつけなければいけない点などを重点的
Beyond Hadoop: Next-Generation Big Data Architectures
Beyond Hadoop: Next-Generation Big Data Architectures By BILL MCCOLL of GigaOm Published: October 23, 2010 After 25 years of dominance, relational databases and SQL have in recent years come under fire from the growing “NoSQL movement.” A key element of this movement is Hadoop, the open-source clone of Google’s internal MapReduce system. Whether it’s interpreted as “No SQL” or “Not Only SQL,” the
Cassandra + Hadoop @ApacheCon
This document discusses using Apache Hadoop for analytics on data stored in Apache Cassandra. It describes how Cassandra is optimized for fast writes and tunable consistency, while Hadoop supports analytics through MapReduce and tools like Pig and Hive. The document provides a recipe for overlaying Hadoop on a Cassandra cluster to leverage data locality for analytics processing. Examples are given
Cloudera Blog
In an era where artificial intelligence (AI) is reshaping enterprises across the globe—be it in healthcare, finance, or manufacturing—it’s hard to overstate the transformation that AI has had on businesses, regardless of industry or size. At Cloudera, we recognize the urgent need for bold steps to harness this potential and dramatically accelerate the time to […] Read blog post
July HUG Recap (Yahoo! Hadoop Blog)
Thanks to the over 200 developers who came to Yahoo! recently for our monthly Hadoop User Group meeting. The energy in the packed room was phenomenal, and conversations continued long after the formal sessions. Hundreds of Hadoop Fans Flock to Yahoo! for the Hadoop User Group The event started with Nitin Motgi from Yahoo! describing the challenge of content optimization at scale and how Yahoo! is
GitHub - jboulon/Honu: Honu is a large scale data collection and processing pipeline
Honu Honu a large scale streaming data collection and processing pipeline build in the cloud for the cloud. Netflix moved a large portion of their infrastructure to the cloud in order to meet our reliability, scalability and availability requirements. As we solved our reliability, scalability and availability requirements on the application side, we open a new range of challenging problem on the l
Managing Big Data: Architectural Approaches for making batch data available online (Hadoop and Distributed Computing at Yahoo!)
YDN Hadoop and Distributed Computing at Yahoo! Managing Big Data: Architectural Approaches for making batch data available online This is the beginning of an ongoing series of blog posts on “Managing Big Data”. This series will focus on techniques that Yahoo uses to process large volumes of data, ranging from initial collection of data to the end usage of that data. Introduction Over the last seve
ヤフーを変え始めたHadoop
ヤフーが日本独自の検索関連サービスの開発で、オープンソースの分散処理ソフトである「Hadoop」の活用を進めている。Hadoopを使うことで、従来は6時間以上かかった処理がわずか5分半で済むようになった例もある。2009年秋には組織を整備し、適用範囲を全社に広げている。 Hadoopは、米グーグルが開発した分散処理ソフト「Google File System（GFS）」と「MapReduce」を模したオープンソースソフトである（図）。GFSとMapReduceは、グーグルのクラウドを支える基盤技術。Hadoopを使うと、複数台の安価なPCサーバーを連携させ、数十テラ～数ペタバイトに及ぶデ ータを高速に処理できる。 Hadoopを日本国内で最も積極的に利用している企業はヤフーだ。2008年ごろから部署単位でHadoopの導入を進め、Hadoopを使う事例が10件を超えるようになった（表）。
企業で使われるHadoop
Copyright © 2004-2024 Impress Corporation. An Impress Group Company. All rights reserved.
Cassandra+Hadoop
This document discusses using MapReduce with Cassandra. It describes how writing to Cassandra from MapReduce has always been possible, while reading was enabled starting with Cassandra 0.6.x. Using MapReduce with Cassandra provides analytics capabilities and avoids single points of failure compared to MapReduce with HBase. The document covers setup and configuration considerations like locality, a
Private Presentation
Private content!This content has been marked as private by the uploader.
Cloudera Blog
In an era where artificial intelligence (AI) is reshaping enterprises across the globe—be it in healthcare, finance, or manufacturing—it’s hard to overstate the transformation that AI has had on businesses, regardless of industry or size. At Cloudera, we recognize the urgent need for bold steps to harness this potential and dramatically accelerate the time to […] Read blog post
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Towards Enterprise-Class Compatibility for Apache Hadoop (Yahoo! Hadoop Blog)
GitHub - cwensel/riffle: Annotations and Classes for managing and executing dependent processes
https://blogs.oracle.com/datawarehousing/post/2010/01/integrating_hadoop_data_with_o.html
Internet Evolution - Ron Miller - Developers Pile On After Jobs Android Attack
Datameer | A Data Transformation Platform
