After presenting our predictions, some of the surrounding discussion was a sad reflection on the shape of the geospatial industry – the constant clinging to the security blanket of “but we are GIS *Professionals* and our skills are essential” was a particular low point. To me, GIS means clunky desktop software with terrible usability, ugly cartography and elitist terminology – wearing that as a badge of honour is an odd concept.

That aside, my five takeaway predictions for 2015 were:

1) OpenStreetMap to have over one million contributors.
2) Large scale investment in OSM from commercial organisations.
3) Widespread crowdsourcing of geodata to utilise excess cognitive capacity.
4) ‘Big data’ – huge, real-time, actively/passively crowdsourced datasets from the sensor
web.
5) Legislation requiring central and local government to release nearly all PSI to the public
domain.

Even Gary Gale gave me a strange look when talking about point 4, though in the brief time since then he has admitted I was correct. I stress that many of the big datasets coming from the sensor web will be closed, and that new commerical opportunities for geo lie there – whether it be for the data or services with the data.

Point 5 is practically enshrined in law now. I would add one little caveat to point 2 though, I expect government and commercial investment in OSM.

Agi Foresight Study – Christopher Osborne

Yesterday, I wrote  a rather sweary and ill-tempered blog post about the Ordnance Survey’s attempts to change its spots. Lets take a look at what exactly is vexing me about the Ordnance Survey, GeoVation and OpenSpaces.

The Problem – Derived Data

This year’s budget was the government’s chance to follow up on the Cabinet Office’s own findings:

There is a high demand for map-based public sector information services. But the complex and legalistic licensing and charging regime offered by the Ordnance Survey is acting as a barrier, both real and perceived, to innovation in this area…The taskforce judges that the charging and licencing regime stifles innovation in public service delivery and economic activity.

This is no radical, everything must be free open-source die hard saying this. It is the Cabinet Office, the ‘head office of governement’, saying that the Ordnance Survey must change its licensing regime. On the one hand we have OpenStreetMap, where the data is free and I can do pretty much anything I like with the data, and then we have the OS with large up-front license fees and straightjacket like restrictions. Back to the Cabinet Office’s findings:

one large local authority expressed bewilderment to the Task Force that the location data for its own street furniture seemed to be owned by the Ordnance Survey.  The Ordnance Survey often claims derived copyright in public service locations, often despite the original information coming from other public bodies.

Derived Data. The single most stifling element of the Ordnance Survey’s licensing regime is the practice of claiming copyright over any data derived from an OS base map. This has massive implications to anyone in a public sector body, or anyone who wishes to use their data. Any geographical data created by a public sector body (who almost exclusively use OS data) is not their’s to do what they like with, it is claimed by the Ordnance Survey under their copyright. Local authorities cannot share the location of its rubbish bins with the public, does this sound absurd to anybody else? Derived Data stops dead any effective sharing of public geographic data, and any innovation that would come from it.

The Response

With large institutions change is slow, the budget and trading fund review gave the OS 12 months to reassess the way they operate and come up with some answers. And sure enough, in May the OS’ response came, “The Business Strategy Consultation”:

It has been agreed with Ministers to focus the business around five key areas. These are:

1. Promote innovation for economic benefit and social engagement
2. Increase the use of Ordnance Survey data
3. Support the sharing of information across the whole of the public sector
4. Increase efficiency to develop a sustainable business for the future
5. Enhance value through the creation of an innovative trading entity

The overall aim of this new business strategy is to provide the best balance between making information more widely available and creating a sustainable future for Ordnance Survey and the wider market.

A sustainable future for the Ordnance Survey cannot be based around any licensing regime that acts as a lock-in to their customers. We currently have a situation where if you have used OS data, you cannot stop paying their license fees as your data, that you have created, has been partially derived from the OS base maps. I do not wish to enter any debate about funding models, the sustainability of a national mapping agency or any other side issue.

The practice of claiming copyright for derived data must end if any of the Cabinet Office’s or the Ordnance Survey’s new objectives are to be met.

OpenSpace – Not Open

So what exactly have the Ordnance Survey done? Aside from some clumsy youtube marketing of the consultation, so far the answer to the points above has been the launch of the OS Open Space API and the GeoVation events. OpenSpace is an online mapping platform, aimed at non-profit making organisations. The maps are perfectly good, its a nice technical achievement. GeoVation is an attempt by the OS to promote the use of geographical information (ie Ordnance Survey data) to those who might not already be using it. Fine.

The launch of these services are being sold as the answer to all of the OS’ problems, and yet we have heard no mention of derived data. Not one. However, there is a large section on derived data in the Terms and Conditions of the OpenSpace API, some of which I will publish here:

5.4 Derived Data

5.4.1 You may create Derived Data, and You may permit End User’s to create Derived Data, in connection with Your Web Application. In the event that You or any End User creates Derived Data, such Derived Data shall be owned by Us, save that if any Derived Data is created which is a severable improvement (as defined by Commission Regulation (EC) No 772/2004, known as the Technology Transfer Block Exemption) of the Ordnance Survey Data then such Derived Data shall be owned by the person or entity creating the same.

So much for being open, any data created using the OpenSpace API is claimed under OS copyright as derived data. I would like to show an example of why I cannot use OpenSpace. Earlier this year I put together a mapping application for FutureSonic09 the arts, music and environmental festival in Manchester. It was a fun, participative experiment to crowdsource data from the public to try and measure the urban heat island effect of Manchester, called Climate Bubbles. People go out, blow some bubbles and chase them and show us on the map how far they went and in what direction:

Even with a simple application like this, created for the Met Office and Lancaster University, I cannot use the OpenSpace API. If I were to use OpenSpace, then Ordnance Survey claims derived data copyright over whatever data the public contributes. Now I cannot share this data, or use this data myself if I or the third party are not paying Ordnance Survey license fees. So much for the goals of “promoting innovation for economic benefit and social engagement” or “supporting the sharing of information across the whole of the public sector”.

GeoVation – Open Wash

So what is GeoVation?

“Through GeoVation, Ordnance Survey® will offer for the first time public access to its digital mapping products for people developing new ideas.”

Lets go back to a lecture that Tim Berners Lee, the government’s newly crowned open data Czar, gave in 2006 where he made the case for access to raw OS data:

“There’s a moral argument that says, for a well-run country, we should know where we are, where things are, and that data should be available…I want to do something with the data, I want to be able to join it with all my other data”

Tim Berners Lee said that in 2006.  It is now 2009 and we finally have some kind of programme where the OS seems to be offering some kind of access to the data. However, so far this is a whole lot of wash. By that I mean the sort of “green wash” we see with various large energy companies claiming to be green. This is “open wash”, the Ordnance Survey is offering a little bit of access to the data, yet absolutely no freedom to use it.

OpenSpace and GeoVation are both exercises in showing that the Ordnance Survey can be relevant in a world where data and information are shared and free flowing. This is simply not the case while the OS claims copyright over derived data. I will repeat myself:

The practice of claiming copyright for derived data must end if any of the Cabinet Office’s or the Ordnance Survey’s new objectives are to be met.

See our new open data champion, Tim Berners Lee, talk about the possibilities in a world where data is open, shared and free flowing:

The whole aim of this totally worthwhile enterprise is to promote Ordnance Survey data to newbies who may not currently be enjoying the derived data lockin practice of the OS.  I quote their website:

“Through GeoVation, Ordnance Survey® will offer for the first time public access to its digital mapping products for people developing new ideas.”

Absolute genius – give the public access to data! My word, those idiots at Google and Yahoo are in trouble now! I can create awesome mashups, safe in the knowledge that the good ol’ OS is going to extort charge me licensing fees to use my own data. Totally awesome guys!

Now, a few of you may have heard some earlier disparaging comments I might have made… you know, things like:

or

Now, after a warm message from Vanessa, head of the OS I thought a rethink might be best:

I was seeing the error of my ways when Vanessa’s favourite Googler, Ed Parsons, dropped this photo into the mix:

So, let it be known – GeoVation is a totally awesome thing, no really. Now please don’t make me ‘disappear’, I’ll pay your license fees, I’ll do anything, dear God think of my family!

WhereCamp 2009 – ‘Curating Big Data’ with Aaron Cope from Flickr and Tom Carden from Stamen from Christopher Osborne on Vimeo.

Creating meaning from “the abundance of data produced in the precise but distant language of machines”.

Tom Carden from Stamen Design and Aaron Cope from Flickr talk about massive machine generated datasets in general, and the Flickr Alpha Shapes project in particular. Reverse geocoding the geotag of user contributed photos to Flickr to create epresentations of psychogeographic space.

Recorded at the 2009 WhereCamp

Budget Day = Derived Data Day

Tomorrow, or April 22nd is budget day in the UK. With the economy well and truly on the rocks, this year’s budget looks ominous. But forget the small-fry stuff like housing, health care and education, what about geodata?

The Trading Fund Review is also scheduled for release tomorrow, and will effectively decide the Ordnance Survey’s future.  Do they:-

a) Privatise the Ordnance Survey

b) Move to a publicly funded model

c) Split the organisation between some publicly funded and privately run functions

d) Do nothing

Everybody has their opinion on the merits of each, personally I would prefer option ‘b’. Stop the mincing around and pretending that the OS is a self-funding enterprise, it isn’t. Its subsidised indirectly by the taxpayer in the form of licence charges to the Public Sector. Define what we actually want and need from our national mapping agency; do we want to maintain high quality mapping of the UK, do we want to keep the luddite data straightjacket of “derived data”?

Death of Derived Data?

The single most positive change that could come from tomorrow’s fallout, would be the demise of “derived data”. Nearly all publicly owned geo data will be in some way derived from Ordnance Survey data, and the current Crown Copyright restrictions of “derived data” make it impossible to use the data without paying for an Ordnance Survey licence. Removing the digital straightjacket allows for public sector geodata to be freed up and shared, enabling innovation and better public services.  See some great examples of mashups using (mostly screen scraped) public sector data – http://rewiredstate.org/projects

Tomorrow may also mark the death of the Ordnance Survey, who knows, they may be privatised? One thing is certain however, if “derived data” remains the OS becomes irrelevant. To get around the licencing restrictions,  even local authorities are turning to OpenStreetMap – Surrey Heath Borough Council is blaizing a trail and contributing to OSM, the first Local Authority to do so (via @nick_b).

If the Ordnance Survey continues to practice the most ridiculous copryight restrictions, their only customer will be the Royal Geographic Society, nobody else cares anymore.

OpenStreetMap is no longer a quirky, little open-data project. Its massive. With over 100,000 registered users, albeit not all active, the OSM community is huge and especially passionate. The OSM community cares deeply about creating freely available mapping data, and shows no sign of slowing down.

This army of mappers is busily adding nodes and links to a global mapping dataset, that in many urban centres is more detailed and up-to-date than its commercial rivals. We’ve seen Geofabrik and CloudMade launch and provide geo services with OSM data, and this looks to be the start of a growing commercial ecosystem around OSM. So this year State of the Map has an extra day,  “dedicated to the theme of commercial viability of OpenStreetMap”.

Want to get involved?

The OpenStreetMap Foundation will be holding its annual conference in Amsterdam, from the 10th – 11th July 2009.  The conference will feature three days of talks, workshops and discussions by the people who are changing the face of mapping.  This is a conference not to be missed by anyone interested in joining OpenStreetMap’s mapping revolution.  Weekend tickets cost just €100 – and you can still get your ticket at a special early bird rate of €75.  You can find out more about the event here .

If all of the talk of the mapping revolution has got you excited, you can join OpenStreetMap’s efforts to re-map the world.  Signing up is easy and takes just two minutes – to sign up and start mapping, click here.