How often was each Tweet favorited? Now you can tell, with a new column we’ve just added to our Twitter search tool – thanks to ScraperWiki user Alden Golab for suggesting this. You can sort by that column to find the most liked Tweet on a subject. For example, ScraperWiki’s right now is about our London Underground visualization. More […]
Our new US stock market tool
In a recent blog post, Ian talked about getting stock market data into Tableau using our Code in a Browser tool. We thought this was so useful that we’ve wrapped this up into an easy-to-use tool. Now you can get stock data by pressing a button and choosing the stocks you’re interested in, no code […]
The London Underground: Should I walk it?
With a second tube strike scheduled for Tuesday I thought I should provide a useful little tool to help travellers cope! It is not obvious from the tube map but London Underground stations can be surprisingly close together, very well within walking distance. Using this tool, you can select a tube station and the map […]
Book review: Data Science for Business by Provost and Fawcett
Marginalia are an insight into the mind of another reader. This struck me as a I read Data Science for Business by Foster Provost and Tom Fawcett. The copy of the book had previously been read by two of my colleagues. One of whom had clearly read the introductory and concluding chapters but not the […]
Try out the Tableau and QlikView connector
In March, we launched an OData tool. If you use Tableau or QlikView, it lets you easily get and refresh data from ScraperWiki. From today, the OData tool is now available on our new 30 day trial accounts. Which means anyone can try it out for free! Instructions here (particularly for Tableau).
Verified Twitter users
We’ve added a “verified accounts” column to our Twitter friends tool – thanks to ScraperWiki user Delfin Paris for suggesting this. The 1 means it is a Twitter verified account, 0 means it isn’t. You can sort by that column to find all the most notable accounts that are following someone. For example, ScraperWiki has 44 followers who […]
Visualising the London Underground with Tableau
I’ve always thought of the London Underground as a sort of teleportation system. You enter a portal in one place, and with relatively little effort appeared at a portal in another place. Although in Star Trek our heroes entered a special room and stood well-separated on platforms, rather than packing themselves into metal tubes. I […]
Yahoo!Finance to Tableau via ScraperWiki
Our recently announced OData connector gives Tableau users access to a world of unstructured and semi-structured data. In this post I’d like to demonstrate the power of a Python library, Pandas, and the Code in a Browser tool to get “live” stock market data from Yahoo!Finance into Tableau. Python is a well-established programming language with […]
Introducing “30 day free trial” accounts
Last May, we launched free Community accounts on ScraperWiki. We’ve since found that the limit on number of datasets isn’t enough to convert heavy users into paying customers. This matters, because we want to invest more in improving the product, and adding new tools. Today, we’re pleased to announce that we’re introducing a new Free Trial […]
NewsReader – Hack 100,000 World Cup Articles
June 10, The Hub Westminster (@NewsReader) Ian Hopkinson has been telling you about our role in the NewsReader project. We’re making a thing that crunches large volumes of news articles. We’re combining natural language processing and semantic web technology. It’s an FP7 project so we’re working with a bunch of partners across Europe. We’re 18 […]