PyF is a python open source framework and platform dedicated to large data processing, mining, transforming, reporting and more. Thanks to its use of best of breed lazy data flow programming techniques, only one item is processed at a time through a complete network including splitting, merging of the flows : no huge data sets in memory, pyf processes are scalable. Heck, you can even send a branch