Big Data Processing at Spotify: The Road to Scio (Part 2) - Spotify EngineeringIn this part we’ll take a closer look at Scio, including basic concepts, its unique features, and concrete use cases here at Spotify. Basic Concepts Scio is a Scala API for Apache Beam and Google Cloud Dataflow. It was designed as a thin wrapper on top of Beam’s Java SDK, while offering an easy way to build data pipelines in idiomatic Scala style. We drew most of our inspiration for the API from S
GitHub - spotify/scio: A Scala API for Apache Beam and Google Cloud Dataflow.
