The role of an intern is often a lowly one. Intern duties usually consist of the provision of caffeinated beverages, screeching ‘can I take a message?’ into phones and the occasional promenade to the photocopier and back again. ScraperWiki is nothing like that. Since starting in late May, I’ve taken on a number of roles […]
Hi, I’m Matthew Hughes
Hello! My name is Matthew Hughes, and I am Scraperwiki’s newest intern, where I will be working predominantly on product and tools alongside the likes of Chris Blower and David Jones. Currently, I’m reading Computing at Liverpool Hope University, where I am about to enter my second year of study. When I’m not hammering out […]
Hi, I’m Paul
Hi! I’m the latest member of ScraperWiki, joining the Data Science team this week. Data Science is a fascinating new direction for me, being “officially” an Electronic Engineer. I’ve spent the last couple of years in a large company hammering out fast C++ and trying (unsuccessfully) to convert everyone to Python. But what really excites […]
Getting SkilledUp
Guest Post by SkilledUp‘s Nick Gidwani. ScraperWiki is a revolutionary tool. Not just because it allows you to collect data, but because it allows anyone – including journalists who now must specialize in data – to organize and draw conclusions from vast data sets. That skill set (organizing what is now called “big data”) was […]
Combining survey data with scraped data to tell a story
Guest post by Dan Armstrong My last three jobs have involved telling stories with survey data. Since every story requires a conflict, I look for conflicts. For instance, I’ll go to CFOs and ask them if their marketing people are doing a good job. Then I’ll ask the marketers if they think they’re doing a […]
WordPress Titles: scraping with search url
I’ve blogged for a few years now, and I’ve used several tools along the way. zachbeauvais.com began as a Drupal site, until I worked out that it’s a bit overkill, and switched to WordPress. Recently, I’ve been toying with the idea of using a static site generator (a lá Jekyll or Hyde), or even pulling […]
I am Ian, Ian I am*
I have an 8 year itch: I spent the first 8 years of my career as an academic ending up a lecturer in physics at UMIST. Then I was a research scientist at a large “fast moving consumer goods” company for another 8 years. On Monday I started work at ScraperWiki as Senior Data Scientist, […]
Glue Logic and Flowable Data
Guest post by Tony Hirst As well as being a great tool for scraping and aggregating content from third party sites, Scraperwiki can be used as a transformational “glue logic” tool: joining together applications that utilise otherwise incompatible data formats. Typically, we might think of using a scraper to pull data into one or more […]
How do? I’m Zach.
So, a few years ago, I tended to spend my working time explaining emerging tech ideas (generally around Linked Data, Open Data, and APIs) for a UK-based Semantic Web company called Talis. I helped people tell stories, edited an industry magazine, blogged, podcasted and hosted events. Over time, I found the role evolving naturally into […]
My time at the Autocloud
The global CADCAM behemoth known as Autodesk hoovers up another small company every two weeks — a process unlikely to diminish following a $750million bond issue last month. (Well, what else are they going to do with that money?) It was only a matter of time before this happened to me on account of my […]