Easy cluster parallelization with ZeroMQ | mdupEasy cluster parallelization with ZeroMQ May 22, 2015 TL;DR: I design short wrapper scripts to send batch jobs to a cluster. The first architecture (ventilator-worker-sink) is suboptimal, therefore I consider another pattern to dispatch the jobs efficiently. Recently I had to make a big chunk of computations for a publication related to my PhD. I spent quite some time designing a machine learning
