Databricks is a very handy cloud platform for large scale data processing and machine learning using Spark. However it does have some idiosyncrasies. Here are…
Category: Data Science
Occasionally you may want to invoke a stored procedure from your python code in order to manipulate data as part of a larger task. Naively…
In the last blog post I discussed using SQL Alchemy to import SQL database data into pandas for data analysis. But what if you wish…
Sometimes may want to use Python to extract data from a SQL database to analyse using pandas. There are a couple of issues here. Firstly…
One objection many people have to Jupyter Notebooks is the difficulty of producing clean code in them. Lets look at a few tools to help…
Having completed our analysis for the Player Unknown Battlegrounds dataset from Kaggle we can now build a model. We can start by building a very…
Currently there is a fun competition running over on the Kaggle Data Science website. The objective is to use metrics from a large data set…
One big issue with a lot of recursive algorithms is that they can lead to very inefficient algorithms that often demonstrate exponential time requirements. In…
We have visualised our data by counting station, but that is rather hard to put into context without knowing where our counting stations are located.…
Now our dataset is nice and tidy we can move on with visualising it to see what insights we can draw. Lets start by looking…