Don't use Hadoop - your data isn't that big
"So, how much experience do you have with Big Data and Hadoop?" they asked me. I told them that I use Hadoop all the time, but rarely for jobs larger than a few TB. I'm basically a big data neophite - I know the concepts, I've written code, but never at scale. The next question they asked me. "Could you use Hadoop to do a simple group by and sum?" Of course I could, and I just told them I needed t
Minimize your cloud costs with GLPK and Haskell
One of the more important tools in my computational toolbox is linear programming. It's a great way to solve a lot of otherwise difficult problems in a straightforward, nearly black-box manner. I've discovered that a lot of programmers aren't too familiar with it, so I'm writing this tutorial that explains how to use it in practical purposes. The problem Specifically, I'll discuss AWS capacity pla
Why Multi-armed Bandit algorithms are superior to A/B testing
In a recent post, a company selling A/B testing services made the claim that A/B testing is superior to bandit algorithms. They do make a compelling case that A/B testing is superior to one particular not very good bandit algorithm, because that particular algorithm does not take into account statistical significance. However, there are bandit algorithms that account for statistical significance.
Don't use Scatterplots
In a series of blog posts, Gary Rubinstein attempts show that the Value Added Modelling scores recently released by the NYC Department of Education prove that VAM (Value Added Modelling) is not accurate. However, whatever flaws VAM may have, Gary Rubinstein (henceforth GR) hasn't demonstrated them. All he has demonstrated is why you shouldn't use scatterplots. In his series of blog posts, he claim
A High Frequency Trader's Apology, Pt 1
I'm a former high frequency trader. And following the tradition of G.H. Hardy, I feel the need to make an apology for my former profession. Not an apology in the sense of a request for forgiveness of wrongs performed, but merely an intellectual justification of a field which is often misunderstood. In this blog post, I'll attempt to explain the basics of how high frequency trading works and why tr
How to leave academia
So you've decided to leave academia, or are perhaps just thinking about doing so. Welcome to the dark side. I made the transition a few years ago, and since then I've gotten a number of questions about how to do it. Hence, this article. First of all, I'm going to assume you are looking for a technical job, and I'm also going to assume you are coming from a technical field. When I left my postdoc I
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Flash Crash? Or Flash in the Pan?
Why I ask 'how many golf balls fit on a bus?' on job interviews
A High Frequency Trader's Apology, Pt 2
One Hiring Filter that Works
Introducing Hobo