scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

CSS Selectors for Python

Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python