7 key recipes for data engineering

After the construction of several datalakes and large business intelligence pipelines, we now know that the use of Scala and its principles were essential to the success of those large undertakings. In this talk, we will go through the 7 key scala-based architectures and methodologies that were used in real-life projects. More specifically, we will see the impact of these recipes on Spark performa

[kimutansk]

ScalaのMacroで実現するべきかはかなり疑問ですが、「6.Inline data quality」の項目みたいにエラー用カラムを付与するアプローチは面白いですね。