Distributed Dask Arrays
This work is supported by Continuum Analytics and the XDATA Program as part of the Blaze Project In this post we analyze weather data across a cluster using NumPy in parallel with dask.array. We focus on the following: How to set up the distributed scheduler with a job scheduler like Sun GridEngine. How to load NetCDF data from a network file system (NFS) into distributed RAM How to manipulate dat
Multiple Dispatch
tl;dr: We present a multiple dispatch system for Python. We discuss issues that arise from multiple dispatch. We try to allay fears related to these issues. Dispatch Abstract operations like addition, +, have several different implementations. We choose which implementation to use based on the type of the inputs. For example: The addition of two numbers results in arithmetic addition The addition
Python v. Clojure v. Julia
Python v. Clojure v. Julia a contest of text and grouping! tl;dr: We compare Python performance against Clojure, Julia, and Java in text-processing and dynamic collections. Remarkably, Python does well. Note - this post embeds gists for code. These do not render well on Planet pages or on RSS readers like feedly. It may be better to view on the original site Situation I mostly understand numeric p
Parallelism and Serialization
Parallelism and Serialization how poor pickling breaks multiprocessing tl;dr: Multiprocessing in Python is crippled by pickles poor function serialization. The more robust serialization package dill improves the situation. Dill-based solutions for both multiprocessing and IPython.parallel make distributed computing simple again. To leverage the cores found in modern processors we need to communica
SymPy -> Theano -- Code Generation
No one is good at everything, that’s why we have society. No project is good at everything, that’s why we have interfaces. This is the first of three posts that join SymPy, a library for symbolic mathematics, and Theano, a library for mathematical compilation to numeric code. Each library does a few things really well. Each library also over-reaches bit and does a few things not-as-well. Fortunate
Characteristic Functions
In a recent post, Characteristic Functions and scipy.stats, Josef Perktold created functions for the characteristic functions of the Normal (easy) and t (hard) distributions. The t-distribution is challenging because the solution involves special functions and has numerically challenging behavior around 0 for high degrees of freedom. Some quotes The characteristic function for the normal distribut
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Ising models and Numba
Wordcounting and Verbosity
http://matthewrocklin.com/blog/work/2013/10/16/Introducing-PyToolz/
Using SymPy within Theano
Packages Considered Slightly Harmful
SymPy and Theano -- Matrix Expressions
SymPy -> Theano -- Scalar Simplification
Maximum a Posteriori Estimation