It is well known that while in some ways humans have remarkable statistical intuition, we are also susceptible to blind spots which can lead to…
Tag: Testing
I recently needed to handle some arguments for a command line Python program. I considered using the built in sys.argv approach, but decided that it…
Whats worse than having a data pipeline fail. Having a data pipeline apparently succeed but actually fail! While having a pipeline fail is bad, having…
Recently I needed to check for equality between Pyspark dataframes as part of a test suite. To my surprise I discovered that there is no…