The AidData “Skytruthiness” Challenge
One of AidData’s flagship data products is the Tracking Underreported Financial Flows (TUFF) Chinese Aid to Africa dataset. The data is collected using a method which relies heavily on third-party reporting of aid projects from China to African nations. One of the harder problems to solve is whether or not these aid projects actually have occurred or are occurring. There are two potential ways to verify that the projects have occurred. The first is ground truthing: actually sending someone to verify the project occurred. Obviously, this can be expensive! The second is sky truthing: using satellite imagery and remote sensing to see if we can pick up the signature of these development projects without putting boots on the ground. Say for example, we have found some indication using TUFF that a stadium was built in Uganda, we have shown we can skytruth these stadiums using Google Earth. Read more here: http://aiddata.org/blog/the-skys-the-limit-using-satellite-imagery-to-track-development-financeprojects-in-africa
However it remains a tricky and perhaps labor intensive problem! This Challenge is all about attempting to automate this process.
Given the following items:
- A set of latitude and longitude pairs which represent some Stadiums in Ghana;
- A set of latitude and longitude pairs which represent some Dams in Ghana;
- An export of Open Street Map (OSM) data of Ghana in Shapefile, sqlite and PBF formats (available at: ftp://ftp.aiddata.wm.edu/tribehacks);
- the Google Maps API (https://developers.google.com/maps/)
Create an application which:
A) Takes each of the data points in (1) above and finds the nearest object in the OSM data. For example if the row is:
5.5515, 0.1919, Stadium
It would find the nearest Stadium in the OSM file for Ghana for that latitude and longitude. Then..
B) Use the location of the nearest object of found in (A), Save the most detailed satellite image from Google Maps. For example above, it would be the Accra Sports Stadium, and your image would look something like:
NOTE: We only want the satellite image! Not the screen capture of the Google Maps page. You should probably be using the Google Maps API to retrieve your satellite tiles.
C) Your final output should at minimum be a CSV with the original latitude, longitude, object type, as well as six new columns: 1) the OSM node id of the nearest matching object, 2) distance in km of the nearest found matching OSM object, 3) the latitude of the closest OSM object of the same type, 4) the longitude of the nearest OSM object of the same type and 5) the name of the saved image file of the satellite view of the object (please store the files in a single folder), and 6) the URL of the satellite image
D) Please issue a pull-request to this repo with your solution (in a seperate folder). Winning entries must contain all code, contain build instructions and generally be nice to work with. Judging criteria are: completeness of solution, code quality, an innovation (feel free to add cool features we havent thought of).
E) Extend your application to arbitrary object mappings. By this we mean, given a source file with one object type in it, say railroads, ask the user which OSM tags map to that object types.
F) DOUBLE AWESOME BONUS POINTS: Integrate CesiumJs (https://cesiumjs.org) into your application.
1) The stadium and dam object tags the source data maps to a very specific OSM tag.