ScraperWiki is sad to hear that Guardian Local is being wound down, just over a year after its public launch. We’ve had the good fortune to work with the talented Guardian Local journalists at three of our Hacks & Hackers events: in Cardiff, Leeds and Glasgow. We would like to say a particular thank you […]
Meet the User – Brewing up a data storm
By taking part in BigClean we got some very interesting users sharing space with you here on ScraperWiki. It being hosted in Prague meant we got to show off our installation of unicode! So meet (takže sa môžete zoznámiť) Stefan Urbanek. His project, Data Brewery, is a Python framework for data mining. It’s like a coder’s version of […]
Take a Look at This
Here at ScraperWiki we’re not just about scraping but also about viewing the work you’ve scraped. In this case, ‘The Julian’, didn’t even scrape! He got it from The Guardian Data Blog. They posted an animated history of UK aid 1960-2009 mapped. Spanish design house Bestiaro produced it using OECD aid data. All ‘The Julian’ had to […]
Hacks & Hackers Glasgow: the BBC College of Journalism video
Last month we celebrated the final leg of our UK & Ireland Hacks & Hackers tour in Glasgow, at an event hosted by BBC Scotland and supported by BBC College of Journalism and Guardian Open Platform. You can read more about it here. Other coverage includes: Guardian Local (Edinburgh) Guardian Developer blog The BBC College […]
Scrape it – Save it – Get it
I imagine I’m talking to a load of developers. Which is odd seeing as I’m not a developer. In fact, I decided to lose my coding virginity by riding the ScraperWiki digger! I’m a journalist interested in data as a beat so all I need to do is scrape. All my programming will be done […]
Meet the User – Robert Brook
Here at ScraperWiki we’re all about making your lives easier (and our lives harder!). We want to help you help yourselves (and in the process make our lives easier!). Part of that means letting you collaborate and share nifty pieces of code to help build and maintain your scrapers. So welcome to the users corner, […]
ScraperWiki Datastore – The SQL.
Recently at ScraperWiki we replaced the old datastore, which was creaking under the load, with a new, lighter and faster solution – all your data is now stored in Sqlite tables as part of the move towards pluggable datastores. In addition to the new increase in performance, using Sqlite also provides some other benefits such […]
Hacks & Hackers Cardiff: the video
Gavin Owen, a recent postgraduate student at the Skillset Media Academy Wales, has produced this excellent video from the Hacks & Hackers Hack Day in Cardiff last month. Read about the projects here, and watch what the journalists and programmers got up to, below:
#newschallenge: ScraperWiki honoured to be invited to the Knight’s roundtable!
Last Thursday we were very excited to find out that we have been shortlisted by the Knight Foundation for its prestigious #newschallenge competition. This is a very big deal for us as it is such a highly respected organisation internationally. Over 1600 applications were entered in the first round. This was whittled down in the […]
D (ata) + J (ournalism) + Camp 2011 = #djcamp2011
Here at ScraperWiki we like to learn. and we also relish the opportunity to teach. Be it scraping or viewing, Ruby or Python or PHP: we want to spread the data and the scraping knowledge. So it’ll come as no big surprise that our head professor, Francis Irving, will be lending a scraping hand at […]