Case Studies – ScraperWiki https://blog.scraperwiki.com Extract tables from PDFs and scrape the web Tue, 09 Aug 2016 06:10:13 +0000 en-US hourly 1 https://wordpress.org/?v=4.6 58264007 Meet all our users!!!! https://blog.scraperwiki.com/2011/10/meet-all-our-users/ Fri, 21 Oct 2011 17:02:22 +0000 http://blog.scraperwiki.com/?p=758215690 As I have been looking for your great guys to highlight your work, passion and scraping oddities, so your time has come to explore the craven habits of the new age data digging programmers! You can now search for people on ScraperWiki!!!! Just use our regular search box.

So all you ScraperWikians out there, I suggest you fill in your profile, put up a picture of your beautiful faces (or cats, whatever floats your boat) and introduce yourself to the data curious world. If you search for ‘scraperwiki‘ on Twitter you’ll also find conversations between developers linking to their scrapers. If you want the wider scraping community to get in touch, please include your Twitter handle or links to any of your other public account.

So let’s spread the ScraperWikiLovin’ but please no unsavoury solicitations. There are plenty of other services for that and if you are resorting to a data wrangling platform you’ve got serious issues.

]]> 758215690 ScraperWiki-ing Down Under https://blog.scraperwiki.com/2011/03/scraperwiki-ing-down-under/ https://blog.scraperwiki.com/2011/03/scraperwiki-ing-down-under/#comments Mon, 21 Mar 2011 13:52:36 +0000 http://blog.scraperwiki.com/?p=758214475 Streuth! You never know what’s been drilling around on ScraperWiki. If you’ve been too busy hacking away on your own projects you probably haven’t noticed a major undertaking right here on our wiki. Open Australia have made their planning alerts scrapers on the site and we’d like to take this moment to say: “G’day”.

PlanningAlerts.org.au started life as a port of the PlanningAlerts.com codebase, which scrapes development application information from councils and sends email alerts of planning applications nearby to the user. It has since significantly evolved and is now a Ruby on Rails application that has sent almost one million development applications to people throughout Australia.

“We’ve started to use ScraperWiki because it makes collaboratively fixing scraper problems much simpler”
– Henare Degan (openaustralia)

Open Australia were finding Councils update their development application pages quite regularly. As a result, almost 30 percent of their scrapers broke. By having the visibility of what scrapers are broken, OpenAustralia volunteers can quickly dive in and make the changes required to fix broken scrapers on ScraperWiki. This is where our email alerts come in to play.

“Because of the email alerts, I’ve been able to quickly correct [broken scrapers] meaning more development applications are flowing to PlanningAlerts. The real power for me is that ScraperWiki handles the regular runs of scrapers and the email alerts are a killer feature”
– Henare Degan (openaustralia)

Open Australia are hoping to get more and more scrapers onto ScraperWiki so that other contributors will come on board to maintain the scrapers and write new ones. Whilst this hasn’t been realised yet, it would mean PlanningAlerts covers more and more of the country. And this collaboration is at the core of ScraperWiki so we wish them all the best.

Australia Planning Applications – you’ve been ScraperWikied!

]]> https://blog.scraperwiki.com/2011/03/scraperwiki-ing-down-under/feed/ 3 758214475