Factual processes nontrivial amounts of data. Our analyses may range over 1011 records, reading hundreds of gigabytes to hundreds of terabytes of source data and intermediate representations. At this scale, performance optimizations can save us significant time and money. We use VisualVM, jhat, and Yourkit for memory and CPU profiling, and the excellent Criterium for microbenchmarks in Clojure. Th
Processing data can be a real a mess! Here at Factual we’ve felt the pain of managing data workflows for a very long time. Here are just a few of the issues: a multitude of steps, with complicated dependencies code and input can change frequently — it’s tiring and error-prone to figure out what needs to be re-built inputs scattered all over (home directories, NFS, HDFS, etc.), tough to maintain, t
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
処理を実行中です
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く