NLUD_2008 | ScraperWiki

ScraperWiki Classic has gone read-only. Try the new ScraperWiki or Transfer this scraper to Morph.io

A temporary version of your scraper has been saved. Discard this scraper

This scraper is protected: You can only watch other people editing. Make my own copy of this scraper

Warning: You are viewing an earlier version of this scraper. If you save, the newest version will be overwritten!

XXXX is currently editing this scraper. Steal control

Back to scraper overview

import scraperwiki
import xlrd

print dir(scraperwiki.geo)

def nlud_scrape(url):
    data = scraperwiki.scrape(url)
    
    book = xlrd.open_workbook(file_contents=data)
    sheet = book.sheets()[1]
    
    columns = list(sheet.row_values(0))
    
    for i in range(2, sheet.nrows):
        row = sheet.row_values(i)
        data = dict(zip(columns, row))
        easting = data.pop("EASTING")
        northing = data.pop("NORTHING")
        latlng = scraperwiki.geo.os_easting_northing_to_latlng(easting, northing)
        uk = list(data.keys())
        data["latlng_lat"] = latlng[0]
        data["latlng_lng"] = latlng[1]
        scraperwiki.sqlite.save(unique_keys=uk, data=data, verbose=0, commit=False)
    scraperwiki.sqlite.commit()

nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/North-West-NLUD-2008.xls")
nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/South-East-NLUD-2008.xls")
nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/North-East-NLUD-2008.xls")
nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/Yorkshire-Humber-NLUD-2008.xls")

nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/West-Midlands-NLUD-2008.xls")

nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/East-Midlands-NLUD-2008.xls")

nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/East-of-England-NLUD-2008.xls")

nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/London-NLUD-2008.xls")

nlud_scrape("http://www.homesandcommunities.co.uk/public/documents/South-West-NLUD-2008.xls")

Documentation

Transfer to Morph.io

Console
Data
Sources
Chat