This is the first part of a 2 part blog series. In this series we will talk about Scio, a Scala API for Apache Beam and Google Cloud Dataflow, and how we built the majority of our new data pipelines on Google Cloud with Scio. Scio > Ecclesiastical Latin IPA: /ˈʃi.o/, [ˈʃiː.o], [ˈʃi.i̯o] > Verb: I can, know, understand, have knowledge. Introduction Over the past couple of years, Spotify has been mi
![Big Data Processing at Spotify: The Road to Scio (Part 1) - Spotify Engineering](https://cdn-ak-scissors.b.st-hatena.com/image/square/ab67a9f60f7c5de5c95e08fff1a4ee840167c56b/height=288;version=1;width=512/https%3A%2F%2Fstorage.googleapis.com%2Fproduction-eng%2F1%2F2017%2F10%2Fscio-logo-2.png)