What could a journalist do with ScraperWiki? A quick guide
For non-programmers, a first look at ScraperWiki’s code could be a bit scary, but we want journalists and researchers to make use of the site, so we’ve set up a variety of initiatives to do that.
Firstly, we’re setting up a number of Hacks and Hacker Days around the UK, with Liverpool as our first stop outside of London. You can follow this blog or visit our eventbrite page to find out more details.
Secondly, our programmers are teaching ScraperWiki workshops and classes around the UK.
Anna Powell-Smith took ScraperWiki to the Midlands, and taught Paul Bradshaw’s MA students at Birmingham City University the basics. Paul has written up some notes at this link.
Julian Todd ran a ‘Scraping 101’ session at the Centre for Investigative Journalism summer school last weekend. He ran through the basics of ScraperWiki and showed how he was using it to map and track offshore oil wells in the UK.
You can see his slides here at this link.
Julian explained just why ScraperWiki is useful…
Your options for webscraping
1. Do the coding yourself
2. Get someone else to code it for you
3. Have it done already!
Number 3 is where ScraperWiki, a place for sharing scrapers, comes in.
Last month, ScraperWiki spoke and also manned a stall at Journalism.co.uk’s news:rewired event. You can read a write-up of Francis Irving’s presentation here by Journalism.co.uk’s Rachel McAthy:
The presentations were concluded by Francis Irving, developer for ScraperWiki, who outlined how they can help journalists transform confusing data into a newsworthy story. He showed two examples of datasets the company can ‘scrape’ data from, producing more accessible tables or even visualisations such as maps, saving journalists’ time.
(Some more general points from the session can be read here)
Meanwhile, Jon Jacob from the BBC College of Journalism caught Francis on video…
If you have any questions about ScraperWiki or our Hacks and Hackers events please contact Aine McGuire: aine [at] scraperwiki [dot] com.
Are there any plans for a tutorial in London at any time soon? I’ve got a little scraper that I’d be happy to share, its a yahoo pipe and will generate an RSS feed from a regularly updated page section. It’s good for sites that don’t have their own RSS feeds.
http://pipes.yahoo.com/pipes/pipe.info?_id=d73238e8659ada8c3b6edeb828cf7270