Awesome Open Source
Awesome Open Source


Place stars⭐ before you leave(记得点个星⭐哦)
web crawling & scraping framework for Python


pyReptile is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.


  • Python 3.5+
  • Works on Linux, Windows, Mac OSX, BSD

  • Get A Weekly Email With Trending Projects For These Topics
    No Spam. Unsubscribe easily at any time.
    Python (1,146,782
    Framework (6,776
    Crawler (2,881
    Scraping (1,359
    Crawling (368
    Related Projects