Tag Archive for 'gis'

Following Tweeters


The world never stops amazing me, and this time (again) its the QGis community with a new Timeline tool to map geo-coded information over time – very cool but what to do with it?

With a very basic understanding of the Titter API and scripts openly available (remember, I’m no programmer) I captured a morning’s worth of Twitter data and plotted the geo-coded tweets as a time-lapse sequence.

httpv://www.youtube.com/watch?v=PWMkT5y0uhw

I’ll admit its not the most interesting video ever but it does show the power of opensource tools. Not a penny was spent on any of the tools and the base maps; all were Opensource or open-data.

 

 

Visualising NGA broadband


I was recently drawn to the Ordinance Survey’s blog where they had tweeted on image they had received which visualised the postcodes of Great Britain is a rather artistic way. Wondering if this approach was easy to replicate and if other data could be used I had a little play with the DCLG broadband model I’ve used before to see if it was possible to create a short animated sequence which could show the spread of faster broadband.

NGA broadband growth

Click on the image to see it run – it loops back at the end to highlight the gulf between where we’re starting from to where we need to get to.

Its not as polished as the OS image but I think it kind of works. The DCLG data is modelled on the ONS’s super output areas, so I resolved them to postcode level to give more points of light, and the colour simply matches the model’s traffic lights.

At the moment the image only covers England and Wales – Scotland and Northern Ireland have their own statistical output area systems which individually need resolving to postcode level. If I get a quite moment I’ll run additional areas to make the map complete.

Mapping broadband

The debate about broadband evolution and availability seems to become emotive often for want of  hard facts in a digestible from. As I couldn’t find anyone who could provide me with the maps I needed I started my own mini practice alongside my usual strategy work, broadband and related information to support business and technical architecture.

Over the last while I’ve worked with Samknows, the oracle of primary broadband data; blending their data with information from other sources like the Office of National Statistics provides a fantastic insight into broadband availability and the people whose lives it touches.

Representing national data means mapping systems and databases so I’ve built up a substantial repository of data, modelled around a range of mapping tools; working with Samknows as often as I can has resulted in an unparalleled picture of broadband Britain which has unpicked any number of myths and assumptions – certainly plenty of my own.

Below are some examples from this output – contact me if you’d be interested in me helping you understand the broadband landscape in your area.

Trialling broadband speed contours This first one came from recently tinkering around with some of the more hidden tools in my tool-kit to see if there were other ways of portraying the broadband landscape. Blue areas are cooler, slower broadband speeds, rising to warmer, sunlit areas with good performance. Not sure if it quite works or not but its different at least.
Mean distance between neighbours This image uses a model I put together using ONS land-use and population data t create a proxy for the cost and effectiveness of next generation broadband investments. The model estimates the mean distance between neighbours – the further two home are apart, the more expensive they will be to install fibre-optic cables, and the less effective fibre to the cabinet is likely to be.
Enfield ADSL speeds This map of the London Borough of Enfield uses a more traditional approach to mapping broadband speeds reported at ONS Lower Super Output Areas (LSOAs); at this level some of the broadband detail is lost but it does allow the data to be linked to other public datasets like deprivation indices or transport data.
Final Third Parliament map This was just a bit of election fun really – what would parliament look like if only MP’s who represent constituencies in the “Final Third” could form the Government.
DCLG NGA model for Cumbria at 70% The Department for Communities and Local Government (DCLG) commissioned a model which attempted to predict next generation access broadband for a number of penetration levels. This is the result for Cumbria should reach 70% of the UK population.

Wow!!


I’ve been dabbling in systems for a while now, looking at how broadband and social data can be combined to better understand the nature of the digital divide, and to just simply understand what the broadband landscape really looks like.

For broadband information there is only one source of reliable primary data – .

For reliable social data the ONS is pretty good although finding exactly what you want can be a bit of chore  but  with the new data.gov.uk website this is only going to get better.

But at some point you need to combine all this information on a map. The UK and Ireland are fairly unique here in having a service that produces fantastically accurate and useful maps but the down side of this is that for most applications today this level of detail is rarely necessary but and the process is mind bogglingly expensive. The impact has been that I could find perfectly adequate maps of almost anywhere in the world to model my data but for a long time really struggled to find an affordable compromise in the UK.

I then started to use Openstreetmap – an /creative commons mapping project which has through leaps and bounds got better and better. With the entire world held in a database on my machine I’m able to produce perfectly reasonable maps for most of the work I do – except in the most important areas I need to understand – rural areas. Openstreetmap relies on the goodwill of its supporters to trace using GPS the areas it maps – fewer people live in rural areas so naturally less of it is mapped well.

Its felt like the OS have fought to retain their right to charge very large sums to anyone wanting access to their data, regardless of the use and need, so it was with a sense of cynicism I decided to take a peek at the ’s Opendata website launched last week – the place the OS have released some of their map information to the public.

There is only one word which really captured what I found:

WOW!!

There are geo-coded maps of various scales in glorious detail and superb quality ready to be loaded straight into my tools.

There is a variety of GIS files which provide any number of other locational resources including parliamentary constituency boundaries, councils, the lot.

And there is a file which says where each and every postcode is

So like a child in a sweetshop I delved in, downloading all the files which I’d wanted for so long but had to cobble together from secondary sources – now I had them in the original form from the most respected map makers in the world.

But then a problem – one of the files, the one I really wanted containing postcode data, didn’t download. So I dropped the OS a line expecting an automated reply in a day or two, leading to some perfunctory reply in a few days to say it was really my fault and to try again.

How wrong – within a few minutes I got an apologetic mail from Jamie, one of their developers on their help desk, asking a few sensible questions and we exchanged a few more emails before his shift finished, when I got a new thread from Dr Paul who picked the problem up until it was fixed. It seems a bit of test data in their Goliath system had refused to be flushed from a cache somewhere which given the scale of their launch is a pretty minor problem.

The launch of the data is absolutely fantastic – their support during the launch is something else!

Hats off to the Ordinance Survey – I’m off to do some mapping!



Get Adobe Flash playerPlugin by wpburn.com wordpress themes

Page optimized by WP Minify WordPress Plugin