【CyberAgent】技術情報／TechReport - テックレポート／FlumeとGrowthForecastを使ったリアルタイムログ解析 | 株式会社サイバーエージェント
14 users
1. 概要 行動ログの分析が日増しに重要度を増していく中で、時間ごとの定期バッチでの処理ではなくリアルタイムな解析が今必要とされている。この要望に対して、リアルタイムログ収集ツールである「Flume」とWebAPIを利用したグラフ化ツール「GrowthForecast」... 続きを読む
1 RT▼
1 RT
IT検証ラボ - ログ収集基盤のFluentdとFlume NG、どちらが使いやすい？：ITpro
71 users
ログは、システムの障害解析（デバッグ）や運用モニタリングに使うことを想定して、コンピュータに発生したイベントの履歴を時系列に沿ってファイルに出力したものである。有用なデータではあるが、扱いにくい面がある。そのため、複数のログを突き合わせて分析... 続きを読む
5 RT▼
5 RT
Musings - Being at Funzio - Part 4 of N
1 user
4 - Flume and Fire Fighting [ Note: This is a fairly long post. It also leans more on the technical side but I have tried to keep it as simple as possible. I felt the need to go into this much detail because the experience described below has... 続きを読む
sharad_ag • Durable Event Data Transport at Scale
2 users
Durable Event Data Transport at Scale A lot is spoken about parallel computing, large scale storage and realtime analytics these days. Relatively lot less is said about transporting event data from producer to consumer reliably and at scale. ... 続きを読む
すべて表示
Flume NG - Apache Flume - Apache Software Foundation
4 users
Overview This is the top level section for all Flume NG (developer) documentation. Flume NG is a refactoring of Flume and is tracked in FLUME-728. From the JIRA's description: To solve certain known issues and limitations, Flume requires a re... 続きを読む
1 RT▼
1 RT
すべて表示
Flume NG
3 users
Overview This is the top level section for all Flume NG (developer) documentation. Flume NG is a refactoring of Flume and is tracked in FLUME-728. From the JIRA's description: To solve certain known issues and limitations, Flume requires a re... 続きを読む
Distributed Flume Setup With an S3 Sink | Erics Tech Blog
3 users
I have recently spent a few days getting up to speed with Flume, Cloudera‘s distributed log offering. If you haven’t seen this and deal with lots of logs, you are definitely missing out on a fantastic project. I’m not going to spend time t... 続きを読む
What are issues to be aware of when deploying Flume in production? - Quora
3 users
What are the configuration options that generally should be changed? What common mistakes have been made in deployments? The most important is to understand the guarantees (and non-guarantees) Flume provides. Things to consider / know about b... 続きを読む
Who is using Flume in production? - Quora
3 users
We (SimpleGeo) are using flume in production. It is installed on all of our production nodes. We run on EC2 and have ~40 nodes relay to 3 collectors on the east coast. Our HDFS cluster is on the west coast, so the 3 collectors on the east ... 続きを読む
Death by Data Data: More Tricks with Jruby and Flume (and HBase)
1 user
Saturday, February 26, 2011 More Tricks with Jruby and Flume (and HBase) Last time, I set up Flume with a jRuby decorator and managed to process exactly one event with my jruby-flume script. Now we are going to dig in a little deeper and do s... 続きを読む
Inside Flume
14 users
Inside Flume - Presentation Transcript Inside Flume Henry Robinson henry@cloudera.com @henryr Tuesday, 17 August 2010 Who am I? • Distributed systems guy • Apache ZooKeeper committer • I work at Cloudera on Flume, ZooKeeper, Hue, more... ... 続きを読む
すべて表示
