Someone I know was moaning recently about a lot of tedious electronic form filling they had to do for work. It was something that happened once a year, but it was much more lengthy and tedious this year than before. It struck me that this was a sharply focused example of when user experience (UX) … Continue reading User experience (UX) and data quality
Category: Data processing
GB roads with gaps
I was driving recently, and realised that I was near a road that appeared to have a large gap. By that I mean: road A joins road B and stops, but some distance further along B there’s a bit more road A. It’s as if A has been chopped into two by B, and the … Continue reading GB roads with gaps
Mental models for data processing
I was having a conversation today with someone about ETL pipelines, and I realised that the word pipeline brought along only some of the associations that would be helpful in data processing. In this article I will go through three different terms, and the associations they each bring. I think that they’re all useful in … Continue reading Mental models for data processing
Analysing the names of artists in the UK music charts using R
This is a silly little bit of data crunching and very limited visualisation, based on the names of artists who have been in the UK music charts. I fancied using R for a change and also trying out notebooks (I’ll explain both a bit below), and this seemed to be about the right size and … Continue reading Analysing the names of artists in the UK music charts using R
Capital cities and US place names
This blog post came about because I remembered that there’s a place in Texas called Paris. That got me to wonder: How many countries’ capitals share a name with somewhere in the USA? It seemed to be about the right size of project to tackle, and one I could do without any coding. Like with … Continue reading Capital cities and US place names
How far away from here is the most distant bit of the UK?
This article is the first in a series: How far away is the most remote part of the UK?How far away is the closest bit of the EU?Which bits of the EU are the closest? I like visualisations, particularly map-based ones. Done well, it’s as if they give you superpowers or a microscope or telescope … Continue reading How far away from here is the most distant bit of the UK?
From Excel to SSIS, Part 5: Joining streams of data
This article is part of a series: From Excel to SSIS Getting started File Save As (a kind of Hello, World! program for SSIS) Filtering rows Grouping and calculating Joining streams of data 0. Introduction This article will cover another very useful chunk of SSIS - joining streams of data together. Often the value of two bits … Continue reading From Excel to SSIS, Part 5: Joining streams of data
From Excel to SSIS, Part 4: Grouping and calculating
This article is part of a series: From Excel to SSIS Getting started File Save As (a kind of Hello, World! program for SSIS) Filtering rows Grouping and calculating Joining streams of data 0. Introduction Over the articles in the series, we have been gradually working our way towards useful and interesting SSIS code. So far we … Continue reading From Excel to SSIS, Part 4: Grouping and calculating
From Excel to SSIS, Part 3: Filtering rows
This article is part of a series: From Excel to SSIS Getting started File Save As (a kind of Hello, World! program for SSIS) Filtering rows Gouping and calculating Joining streams of data 0. Introduction This is the first article in the series where we will do something with the data as it flows through SSIS, rather … Continue reading From Excel to SSIS, Part 3: Filtering rows
From Excel to SSIS, Part 2: Hello, World!
This article is part of a series: From Excel to SSIS Getting started File Save As (a kind of Hello, World! program for SSIS) Filtering rows Gouping and calculating Joining streams of data 0. Introduction In the previous post I introduced SSIS and how to install it. In this post I will take you through … Continue reading From Excel to SSIS, Part 2: Hello, World!