Appendix — Scrapy Tutorial

This tutorial is sourced from scrapy.org. Advanced users should refer to the scrapy.org website for full documentation on the Scrapy platform.

The tutorial uses the website quotes.toscrape.com, a website that lists quotes from famous authors, for demonstration. The tutorial will walk you through the following tasks as we scrape the site:

  1. Creating a new Scrapy project.
  2. Writing a spider to crawl a site and extract data.
  3. Exporting the scraped data using the command line.
  4. Modifying the spider to recursively follow links.
  5. Using spider arguments.

Note — Installing Scrapy: If it is not installed, you may install Scrapy through pip:
pip install Scrapy


Previous     Next

Use the Search Bar to find content on MarketingMind.