Scheduling! Keep your data fresh
We’ve added scheduling to the “Code in your browser” tool on beta.scraperwiki.com.
For now it is daily, as that covers most people’s uses. Please ask if you need something else! Or have a look at the tool’s source code.
Want to know how to use the new ScraperWiki? There’s a quick start guide to coding in your browser on it.
Hi guys, will the new version support private scapers like the current private vault? I’m thinking about upgrading to a Business account on the current live version. But really wont to know if this feature won;t be dropped in future versions..
Yes! On the new ScraperWiki, everything is private by default.
Alright! And how about possibilities for a custom schedule? I’d really love to see the ability to schedule at several date/times; like run at sunday’s at 13:00 or run at 27/05/2013 13:00. Now I use reminders on my phone to manually start a scraper.
You can do it by setting a crontab with whatever times you like. However, to do so you have to SSH in to your box. See https://beta.scraperwiki.com/help/developer/#boxes-unix and https://beta.scraperwiki.com/help/make-your-own-tool/
Ah, I didn’t know that! Sound really promising. Is there any documentation on this feature? I got connected to the SSH, but from there on I really don’t know what to do.. for instance; where can I find the code I’ve created in the web interface