Skip to content

Scrapy project

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

Popular repositories

  1. scrapy Public

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    Python 41.6k 9.3k

  2. scrapyd Public

    A service daemon to run Scrapy spiders

    Python 2.4k 530

  3. scrapely Public

    A pure-python HTML screen-scraping library

    HTML 1.8k 252

  4. dirbot Public

    Scrapy project to scrape public web directories (educational) [DEPRECATED]

    Python 1.6k 1.1k

  5. This is a sample Scrapy project for educational purposes

    Python 1.1k 693

  6. parsel Public

    Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

    Python 698 106