Performance testing of pyspark code #21
Description
Run the main.py file in the src_spark folder against datasets of increasing size from 500mb to 10GB and compare it against runs in the src folder when using pandas.
{{ message }}
Run the main.py file in the src_spark folder against datasets of increasing size from 500mb to 10GB and compare it against runs in the src folder when using pandas.