Silk is a framework for building and running complex workflows of distributed data processing. It allows describing dataflows in Scala in a type safe and concise syntax. Silk translates Scala programs into logical plans and schedules the distributed execution through various "weavers" like an in-memory weaver or Hadoop weaver. It performs static and run-time optimizations of dataflows and supports
![Streaming Distributed Data Processing with Silk #deim2014](https://cdn-ak-scissors.b.st-hatena.com/image/square/ebcac89206a7511464e0d5683910c1daa4072c5e/height=288;version=1;width=512/https%3A%2F%2Fcdn.slidesharecdn.com%2Fss_thumbnails%2F2014-03-03-silk-deim2014-140302235603-phpapp01-thumbnail.jpg%3Fwidth%3D640%26height%3D640%26fit%3Dbounds)