Treasure Data and AWS - Developers.io 2015

Treasure Data and AWS - Developers.io 2015AI-enhanced description This document discusses Treasure Data's data architecture. It describes how Treasure Data collects and imports log data using Fluentd. The data is stored in columnar format in S3 and metadata is stored in PostgreSQL. Treasure Data uses Presto to enable fast analytics on the large datasets. The document provides details on the import

[yass]

" LIST API has a critical problem… ;( > LIST skips some objects when high-loaded environment > It doesn’t return an error…"

[kimutansk]

S3のEventual Consistencyへの対応、非常にベタな方法で実施していたんですね・・後ユーザエラー／リソース不足／内部エラーの区別による分類は基本ですが重要ですね

[moguno]

MATSUO a.k.a マッツォ wrote: Treasure Data and AWS - Developers.io 2015 #treasuredataawsdevelopersio http://t.co/xweYTHwHnD @SlideShareさんから