Changes made to the suggested cell are not reflected in the suggestion widget. Accepting a suggestion overwrites the content of the suggested cell. To address these issues, you can install an ...
export PYSPARK_SUBMIT_ARGS=' --conf spark.sql.shuffle.partitions=700 --conf spark.default.parallelism=700 --driver-memory 30g --driver-cores 6 --executor-memory 30g --executor-cores 6 pyspark-shell' ...