ScraperWiki Classic is now read-only.
But don’t worry! You can transfer this scraper to Morph.io if you want to continue editing it.Transfer to Morph.io
Idle – not scheduled to run
Scraped 526 pages from www.marketnews.usda.gov
About this scraper
Scrapes commodities categorized under “Browse by Commodity” at this USDA Market News site: http://www.marketnews.usda.gov/portal/fv. Each day, the database stores category, commodity, lowPriceMin, highPriceMax, cityName, originName, itemSize, date and a pointer to the XML source. Currently it parses the XML source into the data store, but this is too slow (the connection frequently times out). I'd like to change it to parse the HTML table on the commodity page instead. (Feel free to do so!) Timeout errors create holes in the data.
This scraper is public
Anyone can see this scraper, and any registered user can edit it.
Users who have contributed to this scraper:
This scraper’s datastore
- Download SQLite database
This scraper’s history