wiki – ScraperWiki https://blog.scraperwiki.com Extract tables from PDFs and scrape the web Tue, 09 Aug 2016 06:10:13 +0000 en-US hourly 1 https://wordpress.org/?v=4.6 58264007 ScraperWiki-ing Down Under https://blog.scraperwiki.com/2011/03/scraperwiki-ing-down-under/ https://blog.scraperwiki.com/2011/03/scraperwiki-ing-down-under/#comments Mon, 21 Mar 2011 13:52:36 +0000 http://blog.scraperwiki.com/?p=758214475 Streuth! You never know what’s been drilling around on ScraperWiki. If you’ve been too busy hacking away on your own projects you probably haven’t noticed a major undertaking right here on our wiki. Open Australia have made their planning alerts scrapers on the site and we’d like to take this moment to say: “G’day”.

PlanningAlerts.org.au started life as a port of the PlanningAlerts.com codebase, which scrapes development application information from councils and sends email alerts of planning applications nearby to the user. It has since significantly evolved and is now a Ruby on Rails application that has sent almost one million development applications to people throughout Australia.

“We’ve started to use ScraperWiki because it makes collaboratively fixing scraper problems much simpler”
– Henare Degan (openaustralia)

Open Australia were finding Councils update their development application pages quite regularly. As a result, almost 30 percent of their scrapers broke. By having the visibility of what scrapers are broken, OpenAustralia volunteers can quickly dive in and make the changes required to fix broken scrapers on ScraperWiki. This is where our email alerts come in to play.

“Because of the email alerts, I’ve been able to quickly correct [broken scrapers] meaning more development applications are flowing to PlanningAlerts. The real power for me is that ScraperWiki handles the regular runs of scrapers and the email alerts are a killer feature”
– Henare Degan (openaustralia)

Open Australia are hoping to get more and more scrapers onto ScraperWiki so that other contributors will come on board to maintain the scrapers and write new ones. Whilst this hasn’t been realised yet, it would mean PlanningAlerts covers more and more of the country. And this collaboration is at the core of ScraperWiki so we wish them all the best.

Australia Planning Applications – you’ve been ScraperWikied!

]]> https://blog.scraperwiki.com/2011/03/scraperwiki-ing-down-under/feed/ 3 758214475