Factual | Profiling Hadoop Jobs With Riemann
Factual processes nontrivial amounts of data. Our analyses may range over 1011 records, reading hundreds of gigabytes to hundreds of terabytes of source data and intermediate representations. At this scale, performance optimizations can save us significant time and money. We use VisualVM, jhat, and Yourkit for memory and CPU profiling, and the excellent Criterium for microbenchmarks in Clojure. Th
Programming Hadoop with Clojure
This article is a short introduction into programming Hadoop using Clojure language. Introduction The Hadoop is free implementation of infrastructure for scalable, distributed computing. It was started as implementation of ideas of MapReduce and GFS, that was introduced by Google, but later, many different projects were included into it. Hadoop is actively used by many projects, including commerci
Lemur: Declarative launching of Hadoop jobs on Elastic-Mapreduce
In this post, I'm announcing a new tool for launching Hadoop jobs locally and on AWS's elastic-mapreduce, (EMR) which I call Lemur. I built this tool for The Climate Corporation (TCC), purveyors of Weather Insurance to the Agriculture Industry. I want to thank TCC for allowing me to open source this work, as well as a great deal of feedback and the original use cases. Overview Lemur is a tool to
Factual | Clojure on Hadoop: A New Hope
Factual’s U.S. Places dataset is built from tens of billions of signals. Our raw data is stored in HDFS and processed using Hadoop. We’re big fans of the core Hadoop stack, however there is a dark side to using Hadoop. The traditional approach to building and running Hadoop jobs can be cumbersome. As our Director of Engineering once said, “there’s no such thing as an ad-hoc Hadoop job written in J
Introducing Cascalog: a Clojure-based query language for Hadoop - thoughts from the red planet - thoughts from the red planet
September 2021 (1) March 2017 (1) January 2017 (1) July 2016 (1) June 2016 (1) September 2015 (1) October 2014 (1) June 2014 (1) May 2014 (1) February 2014 (2) April 2013 (3) March 2013 (1) September 2012 (1) February 2012 (1) January 2012 (1) October 2011 (1) March 2011 (1) January 2011 (3) December 2010 (2) November 2010 (1) October 2010 (2) August 2010 (2) July 2010 (2) June 2010 (1) May 2010 (
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Matt Bossenbroek - PigPen: Map-Reduce for Clojure
Replephant: Analyzing Hadoop Cluster Usage with Clojure
Coming soon
GitHub - alexott/clojure-hadoop: Library to aid writing Hadoop jobs in Clojure.
Static hosting for Bitbucket by Aerobatic
FlightCaster merges its statistical-learning code into Incanter