ScraperWiki

  • ScraperWiki Classic
  • New ScraperWiki
  • Browse Classic Archive
  • Classic Documentation

Documentation

Tutorials, references and guides for coders on ScraperWiki

PHP Python Ruby Choose a language:

First steps

  • First scraper tutorial

    Write a real scraper by copying and pasting code (30 mins)
  • First view tutorial

    Make a view by copying and pasting code (30 mins)
  • Live tutorials

    A series of tutorials that run in our online code editor

Need help?

  • Try the Frequently Asked Questions
  • Chat to other developers on IRC: #scraperwiki on freenode
  • Email your question to the ScraperWiki Google Group
  • Something not working? Check our status page
  • Search for answers or ask new questions on Stack Overflow
  • Check out our bug list and source code on BitBucket

Scraping guides

  • CSV reading guide

    Get data from comma-separated spreadsheets
  • Excel reading guide

    Get data from Excel spreadsheets
  • HTML parsing guide

    Get data from web pages using CSS selectors
  • Dates and times guide

    Parse and save dates and times

Coders reference

  • ScraperWiki library

    ScraperWiki-specific functions you can use inside a scraper
  • Datastore copy & paste guide

    Everything you can do with the ScraperWiki datastore
  • 3rd party libraries

    eg: Mechanize, Beautiful Soup, Geopy
  • ScraperWiki Web API docs

    Build an API query to get data out of ScraperWiki

Viewing guides

  • HTML Views 101

  • Using AJAX with ScraperWiki