Fluentd: the missing log collector software | Treasure Data Community Blog
Fluentd: the missing log collector software Tweet About This post introduces Fluentd, an open-source log collector software developed at Treasure Data, Inc. The Problems The fundamental problem with logs is that they are usually stored in files although they are best represented as streams (by Adam Wiggins, CTO at Heroku). Traditionally, they have been dumped into text-based files and collected by
Amazon Recommends @Fluentd as "Best Practice for Data Collection" over Flume and Scribe | Treasure Data Blog
Amazon Recommends Fluentd as “Best Practice for Data Collection” over Flume and Scribe Tweet This month, Parviz Deyham from Amazon Web Service promoted Fluentd as the best data collection tool for Amazon Elastic MapReduce (EMR), a hosted Hadoop framework running on Amazon Elastic Compute Cloud (EC2) and Amazon Simple Storage Service (S3). In the best practices whitepaper, Parviz, an Enterpise Solu
Treasure Data’s Plazma: Columnar Cloud Storage | Treasure Data Blog
Treasure Data’s Plazma: Columnar Cloud Storage Tweet Treasure Data has been developed by Hadoop experts. We get Hadoop, and, in many ways, it’s part of our core. As we have built out the platform, we noticed that the storage layer needs to be multi-tenant, elastic, and easy to manage while keeping the scalability and efficiency. This led us to create Plazma, our own distributed columnar storage sy
Fluentd + Hadoop: Instant Big Data Collection | Treasure Data Blog
Fluentd + Hadoop: Instant Big Data Collection Tweet About This post describes how to use Fluentd’s newly released WebHDFS plugin to aggregate semi-structured logs into Hadoop HDFS. Background Fluentd is a JSON-based, open-source log collector originally written at Treasure Data. Fluentd is specifically designed for solving big data collection problem. Many companies choose Hadoop Distributed Files
Cookpad Case Study | Treasure Data Blog
Cookpad Case Study Cookpad.com (TYO:2193) is Japan’s No.1 recipe website. With more than fifteen million users and one million online recipes, Cookpad.com dominates the market of recipe search and sharing. In fact, according to Cookpad.com’s internal research, 50% of Japanese women in their 20s and 30s use Cookpad.com as their primary source of recipes and cooking advice. So, how does Cookpad.com
Treasure Data Blog • Real-Time Log Collection with Fluentd and MongoDB
Tweet About This post shows how to use Fluentd-MongoDB plugin to aggregate semi-structured logs in real-time. Background Fluentd is an advanced open-source log collector developed at Treasure Data, Inc (see previous post). Because Fluentd handles logs as semi-structured data streams, the ideal database should have strong support for semi-structured data. There are several databases that meet this
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
