Yahoo Betting on Apache Hive, Tez, and YARN
by The Hadoop Platforms Team Low-latency SQL queries, Business Intelligence (BI), and Data Discovery on Big Data are some of the hottest topics these days in the industry with a range of solutions coming to life lately to address them as either proprietary or open-source implementations on top of Hadoop. Some of the popular ones talked about in the Big Data communities are Hive, Presto, Impala, S
Cloudera Blog
The ongoing progress in Artificial Intelligence is constantly expanding the realms of possibility, revolutionizing industries and societies on a global scale. The release of LLMs surged by 136% in 2023 compared to 2022, and this upward trend is projected to continue in 2024. Today, 44% of organizations are experimenting with generative AI, with 10% having […] Read blog post
High-Performance Big Data :: Home
Overview Welcome to the High-Performance Big Data project created by the Network-Based Computing Laboratory of The Ohio State University. The HiBD packages are being used by more than 365 organizations worldwide in 39 countries (Current Users) to accelerate Big Data applications. As of Apr '24, more than 48,700 downloads have taken place from this project's site. The HiBD project contains the foll
Spotify changes tune on Hadoop with switch to Hortonworks
Music-streaming service Spotify says shifting to Hortonworks' distribution of big-data platform Hadoop will help it advance the analytics behind personalising user services and providing data to record companies. Spotify's Hadoop infrastructure, which stood at about 30 nodes five years ago, is now described as Europe's largest commercial cluster, consisting of 690 nodes storing data from more than
大規模サイトを支えるビッグデータプラットフォーム技術
ヤフーのメタデータ可視化の取り組みについて紹介します。メタデータを３つのlayerに分類してそれぞれの課題と対応について説明します
Hadoop on Mesos at Airbnb
Apache Mesos (http://mesos.apache.org) is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. In this presentation, Airbnb engineer Brenden Matthews explains how they run Hadoop as a Mesos framework. This video was recorded at the July 25, 2013 Mesos meetup, held at TwitterHQ in San Francisco.
It looks like Hortonworks co-founder Baldeschwieler has left the company – Old GigaOm
It appears that Hortonworks co-founder and CTO Eric Baldeschwieler is no longer with the company. Hortonworks is the Hadoop software and services company that spun out of Yahoo in June 2011. Baldeschwieler is no longer listed on the management team page, where former Chief Products Officer Ari Zilka is now listed as CTO. Baldeschwieler’s name has also been removed from the company’s board of direc
A Database-Hadoop Hybrid Approach to Scalable Machine Learning
My presentation slide at IEEE 2nd International Congress on Big Data on June 30, 2013. http://www.ieeebigdata.org/2013/Read less
Cloudera Blog
The ongoing progress in Artificial Intelligence is constantly expanding the realms of possibility, revolutionizing industries and societies on a global scale. The release of LLMs surged by 136% in 2023 compared to 2022, and this upward trend is projected to continue in 2024. Today, 44% of organizations are experimenting with generative AI, with 10% having […] Read blog post
Database startup Drawn to Scale is closing down – Old GigaOm
Database startup Drawn to Scale, creator of the SQL-on-Hadoop technology called Spire, is closing down. Co-founder and CEO Bradford Stephens officially announced the closure in a blog post on Friday. The company’s product, Spire, which provided full SQL support on top of the HBase NoSQL database, was one of the first products to try to blend Hadoop’s scalability with the robustness and familiarity
Hadoopは基幹業務をどう変えるのか─ソフトバンクモバイルにおけるオープンソース活用 | gihyo.jp
Hadoopはバッチ処理の課題への解決策となり得るか 企業のあらゆる領域にITが浸透し、それに伴って会計や在庫管理、あるいは販売管理などシステムから出力されるデータ量も拡大し続けています。このデータ量の増大によって、多くの企業において新たな課題となりつつあるのがバッチ処理の遅延です。 たとえば、毎日の売上を集計するために、販売管理システムからデータを吸い上げてバッチ処理を行うといった場合、サーバリソースに余裕がある夜間にバッチを走らせ、翌朝担当者が出社する頃には集計データが出力されているという形が一般的でしょう。しかし、ITが事業のさまざまな領域で活用されるようになったことから、バッチ処理すべきデータ量は増大し続けています。これにより、バッチ処理が時間内に終わらない、「突き抜け」と呼ばれる事態に頭を悩ませる企業が増えているのです。 突き抜けが発生すると、さまざまな領域に大きな影響が及ぶ恐
Eventbrite
Your version of Internet Explorer is not longer supported. Please upgrade your browser.
Fluentd + Hadoop: Instant Big Data Collection | Architects Zone
Fluentd is a JSON-based, open-source log collector originally written at Treasure Data. Fluentd is specifically designed for solving big data collection problem. Many companies choose Hadoop Distributed Filesystem (HDFS) for big data storage. [1] Until recently, however, the only API interface was Java. This changed with the new WebHDFS interface, which allows users to interact with HDFS via HTTP.
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Hadoop vs. Aster: A Quick Comparison | Gilt Tech
Syncsort & comScore Big Data Warehouse Meetup Sept 2013
Two presentations on Big Data Big Analytics with R | R-bloggers
Why do Column oriented databases such as Vertica/InfoBright/GreenPlum make a fuss of Hadoop?
Cloudera Blog
Which Storage Protocol Is Best For VMware? - Storage Blog - InformationWeek
Loading...