The ScraperWiki truck will be in St Louis, Missouri this Thursday 23rd February. The NICAR event is a wonderful opportunity for us to meet the IRE delegates and to understand the on going issues that investigative reporters face when digging up data. We already have some data sets nominated and these are listed in no […]
What happened in New York
At our New York datacamp, we set out to liberate data, teach people to liberate data, and find stories in data. About 100 people showed up for the event, and about 40 of them attended the Learn to Scrape sessions. The hacking was punctuated by talks by Tom Lee of the Sunlight Foundation and Jake […]
Welcome Jane, from Ubuntu, to ScraperWiki’s board
What’s a company’s board of directors for? Ultimately it’s to hire or fire the CEO. But that doesn’t happen very often. What happens more often is board meetings. But what are they for? They give directors a status update, and are a place to do legal administrivia. But even that is most efficiently done in […]
$1 million to build a data platform
Sometimes the easiest way of being authentic is to just post an email that was written to be private… Date: Fri, 27 Jan 2012 14:29:57 +0000 From: Francis Irving <francis@scraperwiki.com> To: team@scraperwiki.com Subject: Capital! Today we closed our round of investment from Enterprise Ventures and Blue Fountain. In total, provided we hit certain milestones next August, and with […]
Big fat aspx pages for thin data
My work is more with the practice of webscraping, and less in the high-faluting business plans and product-market-fit leaning agility. At the end of the day, someone must have done some actual webscraping — and the harder it is the better. During the final hours of the Columbia University hack day, I got to work […]
100 Years of history…and I just hope that we do it justice…
Columbia University, arguably the best Journalism school in the world is giving us the opportunity of a lifetime. We are hosting our first ever US event (Journalism Data Camp #jdcny) and its their first hackathon in a proud 100 year history. It is scary but very exciting! The campus is lovely and welcoming. Located in […]
Journalism Data Camp NY potential data sets
Here is a review of some of the datasets that have been submitted for the Columbia Journalism Data Camp this Friday. This list is only for backup in case not enough ideas show up with people on the day (never happens, but it’s always a fear). 1. Iowa accident reports The site http://accidentreports.iowa.gov contains all […]
#JDCNY Journalism Data Camp New York – Agenda (Fri 3rd and Sat 4th Feb)
Here is a breakdown on what we are planning for Friday and Saturday… Click the image to see the PDF! Thank you
“the impact on our industry only begins this weekend” says Susan E McGregor, Professor at the world’s foremost school of journalism
This is a guest blog post by Susan E. McGregor – Assistant Professor at the Tow Center for Digital Journalism Columbia University The Tow Center for Digital Journalism at Columbia University Graduate School of Journalism is proud to be partnering with Knight News Challenge winner ScraperWiki this Friday and Saturday for their first Journalism Data […]
How to stop missing the good weekends
Far too often I get so stuck into the work week that I forget to monitor the weather for the weekend when I should be going off to play on my dive kayaks — an activity which is somewhat weather dependent. Luckily, help is at hand in the form of the ScraperWiki email alert system. […]