Recently I needed to check for equality between Pyspark dataframes as part of a test suite. To my surprise I discovered that there is no…