Flumeでセキュアな通信を - Taste of Tech Topics
Hadoopアドベントカレンダーの14日目。 阪本です。 セキュア通信でFlumeを使う方法について書こうと思います。 現行のFlumeには、セキュア通信を行うための仕組みは用意されていません。 完全ローカルで使用するのであれば、それでもよいかもしれませんが、 やはり通信経路のセキュリティは気になるもの。 特に日本ではこのあたり、気にされるんですよねぇ。 そこで、SSHポートフォワード＋Flumeによるセキュア通信をやってみました。 まずは、flume configでの設定。 exec unmapAll exec purgeAll exec map host1 node1_1 exec map host1 node1_2 exec map host2 node2_1 exec map host2 node2_2 exec map host3 collector1 exec map host
Everybody Flumes
Everyone is integrating with ☞ Flume, the distributed, reliable, and available service for collecting, aggregating, and moving large amounts of log data. MongoDB: mongo-hadoop ☞ github.com/mongodb/mongo-hadoop Still experimental, but it has a Flume sync for storing log data into MongoDB. Cassandra: flume-cassandra-plugin☞ gitbuh.com/thobbs/flume-cassandra-plugin A new Cassandra plugin for Flume is
Flume Cookbook
flume-dev@cloudera.org version 0.9.1, September 10, 2010 Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. Being highly configurable and very extensible means that there are many options and thus many decisions that need to be made by an operator. This document is a "cookbook" with "recipes" for getting Flume up
Flume User Guide
flume-dev@cloudera.org version 0.9.0, June 29th 2010 Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. The system is centrally man
Cloudera Blog
In an era where artificial intelligence (AI) is reshaping enterprises across the globe—be it in healthcare, finance, or manufacturing—it’s hard to overstate the transformation that AI has had on businesses, regardless of industry or size. At Cloudera, we recognize the urgent need for bold steps to harness this potential and dramatically accelerate the time to […] Read blog post
Inside Flume
Henry Robinson works at Cloudera on distributed data collection tools like Flume and ZooKeeper. Cloudera provides support for Hadoop and open source projects like Flume. Flume is a scalable and configurable system for collecting large amounts of log and event data into Hadoop from diverse sources. It allows defining flexible data flows that can reliably move data between collection agents and stor
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Real-time Streaming Analysis for Hadoop and Flume
Who is using Flume in production?
Flume @ Austin HUG 2/17/11
Cloudera » Apache Hadoop for the Enterprise