Big Data file formats

Apache Spark supports many data formats, such as the ubiquitous CSV format and the friendly web format JSON. Common formats used mainly for big data analysis are Apache Parquet and Apache Avro. In this post, we will look at the properties of these 4 formats — CSV, JSON, Parquet, and Avro using Apache Spark. CSV CSV files (comma-separated values) usually exchange tabular data between systems using

[U1and0]

JSONのデメリットが浮き彫りになる。webで扱いやすいことくらいしかメリットないのでは。可視性、読み書き込み速度、容量がCSVにかなわない。