Comments on: A small matter of programming https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/ Extract tables from PDFs and scrape the web Thu, 14 Jul 2016 16:12:42 +0000 hourly 1 https://wordpress.org/?v=4.6 By: Zarino Zappia https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-852 Thu, 04 Jul 2013 20:52:29 +0000 http://blog.scraperwiki.com/?p=758217878#comment-852 We’ve set up a new guide that might help answer your questions, Suzana: https://scraperwiki.com/help/scraperwiki-classic – take a look!

You might also want to keep an eye on our blog in the coming week or two. We’ll be posting a lot more about the recent changes, including our plans for encouraging open data use, and the reasoning behind our current account limits.

]]> By: Suzana K https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-851 Wed, 03 Jul 2013 17:21:33 +0000 http://blog.scraperwiki.com/?p=758217878#comment-851 I have 18 scrapers on the old ScraperWiki. Does that mean that I can only migrate 3 of them to the new platform for free?
And how do I migrate them without copying the code manually?

]]> By: Francis Irving https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-850 Tue, 15 Jan 2013 11:00:37 +0000 http://blog.scraperwiki.com/?p=758217878#comment-850 Michael – no changes to the running platform right now. The same code can be transported from one to the other – as the new platform matures, we intend to help everyone migrate over.

]]> By: Michael Bauer https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-849 Tue, 15 Jan 2013 10:39:35 +0000 http://blog.scraperwiki.com/?p=758217878#comment-849 Does this affect the now running platform? I just noted the scraperwiki platform to be defunct.

]]> By: Francis Irving https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-848 Fri, 11 Jan 2013 16:37:34 +0000 http://blog.scraperwiki.com/?p=758217878#comment-848 Hi Joe! Julian is looking at getting all the UN data into that ecosystem. How is your project going?

]]> By: Joe Mitchell https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-847 Fri, 11 Jan 2013 16:30:35 +0000 http://blog.scraperwiki.com/?p=758217878#comment-847 I really, really like the idea of ‘a whole ecosystem of powerful, code-free, web-based tools for data science.’ Keep up the good work.

]]> By: Francis Irving https://blog.scraperwiki.com/2012/12/a-small-matter-of-programming/#comment-846 Fri, 04 Jan 2013 10:28:08 +0000 http://blog.scraperwiki.com/?p=758217878#comment-846 Reuben’s said the diagrams above aren’t quite clear enough, so this comment is to try and explain it a bit more concretely…

Online code editors, and other innovations such as PaaS, make programming easier, and reduce systems administration. However, they don’t magically enable non-programmers to be able to program, that still requires months of work, and a personality that wants to be a programmer.

At the same time, having a very simplified online code editor with its own very simplified PaaS (backend for running the code) isn’t powerful enough for programmers. They complain that they want to use vim or TextMate, the Python debugger or git, Perl or Redis – each one has a different complaint.

There are a few people in the middle who really love such an easy to use online code editor – ScraperWiki Classic has a bunch of fans. However, that isn’t enough.

The new platform we’re making instead has general Unix shell accounts as its backend, so programmers can more easily deploy stuff to it. And has a web frontend to that with tools for anyone (more on this in later blog posts!), which still lets you get to the source code, and run arbitrary code over the web.

]]>