The ScraperWiki digger had been driven far and wide. Wherever there’s open data you’ll find us parked nearby. I’ve noticed it travel across the Atlantic and have contacted the driver – Kevin Curry. He has the grand title (as well as digger driver!) of Chief Scientist and Co-founder of Bridgeborn, Inc. He is computer science […]
meine-demokratie.de at the Open Knowledge Conference’s ScraperWiki Workshop
This is a guest blog post from Tobias Escher, a star ScraperWiki user in Germany. This year’s Open Knowledge Conference takes place in Berlin. While the conference proper starts tomorrow, during the last two days ScraperWiki ran a workshop to scrape and visualise German data. It has drawn a sizeable community of people, from novices […]
ScraperWiki Downtime
In order to allow for essential maintenance (our diggers been digging the web for so long it’s in dire need of an MOT!) we’re going to have to take the ScraperWiki website down for a short amount of time on Wednesday (29th June 2011). The site will be down from 13:00 UTC (14:00 BST). We […]
Meet the User – Philip John
As you can imagine we get a lot of website developers who make pretty, useful things that flash and jump and link. But the humble scraper can do heavy lifting for the building blocks that ultimately make these centres for civic engagement most engaging. So our user of the week is one such developer – […]
Knight Foundation finance ScraperWiki for journalism
ScraperWiki is the place to work together on data, and it is particularly useful for journalism. We are therefore very pleased to announce that ScraperWiki has won the Knight News Challenge! The Knight Foundation are spending $280,000 over 2 years for us to improve ScraperWiki as a platform for journalists, and to run events to bring together journalists […]
Opening Data at Open Knowledge Conference Berlin
If you haven’t already heard, the Open Knowledge Foundation is hosting a one week conference in Berlin next week. We’re very excited and will be running workshops on the Monday and Tuesday. We hope to meet some of our German users and opening data in the way we know best. It’s an all-star line up […]
Protect your scrapers!
You know how it is. You wrote your scraper on a whim. Because it’s a wiki, some other people found it, and helped fix bugs in it and extend it. Time passes. And now your whole business depends on it. For when that happens, we’ve just pushed an update that lets you protect scrapers. This […]
Why the Government scraped itself
We wrote last month about Alphagov, the Cabinet Office’s prototype, more usable, central Government website. It made extensive use of ScraperWiki. The question everyone asks – why was the Government scraping its own sites? Let’s take a look. In total 56 scrapers were used. You can find them tagged “alphagov” on the ScraperWiki website. There are a […]
Meet the User – Tim Retout
You may have noticed some illicit back-alley forking going around on ScraperWiki. The above picture looks very much like my Cabinet Spending Word Cloud Date Slider. Well, to tell you the truth, a gal could do with a bit of forking every now and again! Which is why I’ve nominated Tim Retout (@diocles) as our […]
Meet the User – Robert McWilliam
There’s been a lot of ScraperWiki buzzing going on but not on our site. On Twitter! And I’m not just talking about Scrape_No.10. No, the trend has spread and Edinburgh planning applications are being tweeted out by PlanningAppMap! What’s great about this (besides preventing angry Scotsmen from rioting when their local pub gets torn down […]