How to work with Parquet files using native Python and PySpark.
- Convert a CSV to Parquet with Pandas:
python src/csv_to_parquet.py
- CSV => Parquet with PySpark:
python src/pyspark_csv_to_parquet.py
- CSV => Parquet with Koalas:
python src/koalas_csv_to_parquet.py
Read this blog post for more information on how to write Parquet files with Python.