Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 22 Python Framework Crawler Open Source Projects

Open source projects categorized as Python Framework Crawler
Categories > Data Processing > Crawler
Categories > Frameworks > Framework
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 3 months agopypi Scrapy} Downloads
Grab ⭐ 2,292
Web Scraping Framework
dependent packages 3total releases 120most recent commit 10 months agopypi grab} Downloads
Gain ⭐ 1,972
Web crawling framework based on asyncio.
total releases 5most recent commit 5 years ago
Icrawler ⭐ 792
A multi-thread crawler framework with many builtin image crawlers provided.
dependent packages 5total releases 42most recent commit 4 months agopypi icrawler} Downloads
Dude ⭐ 397
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
total releases 43most recent commit 3 months ago
Sasila ⭐ 264
一个灵活、友好的爬虫框架
total releases 17most recent commit 4 years ago
Rendler ⭐ 247
A rendering web crawler for Apache Mesos.
most recent commit 5 years ago
Aioscpy ⭐ 138
An asyncio + aiolibs crawler imitate scrapy framework
total releases 46most recent commit 5 months ago
Ant_nest ⭐ 93
Simple, clear and fast Web Crawler framework build on python3.6+, powered by asyncio.
dependent packages 1total releases 59most recent commit 2 years agopypi ant-nest} Downloads
Seleniumdemo ⭐ 80
Selenium automation test framework
most recent commit 2 years ago
Scraping Ebay ⭐ 73
Scraping Ebay's products using Scrapy Web Crawling Framework
most recent commit 2 years ago
Fetchman ⭐ 61
fetchman is a simple crawler system/简单好用的爬虫框架
total releases 22most recent commit 4 years ago
Pomp ⭐ 60
Screen scraping and web crawling framework
most recent commit 7 years ago
Image Crawler ⭐ 39
📷 Python application based on flask framework.
most recent commit 8 years ago
Ioweb ⭐ 28
Web Scraping Framework
total releases 26most recent commit 2 years ago
Phages2050 ⭐ 27
PHAGES2050 - a Comprehensive AI-based Framework for Phage Research & Therapy
total releases 10most recent commit 4 years ago
Scrapio ⭐ 16
Asyncio web crawling framework. Work in progress.
total releases 9most recent commit 9 months ago
Seen ⭐ 14
A lightweight crawling/spider framework for everyone(support JavaScript!).✨
total releases 4most recent commit 6 years ago
Tinycrawl ⭐ 9
Very easy and tiny crawling framework, support multithread processing.
total releases 3most recent commit 3 years ago
Airspider ⭐ 8
A Fast and Light Python Spider Framework 🕷️
total releases 6most recent commit 4 years ago
Xpaw ⭐ 6
Async web scraping framework
total releases 27most recent commit 5 years ago
Biu ⭐ 5
biubiubiu~~ I'm a tiny web crawler framework
total releases 13most recent commit 4 years ago
The 4 Most Depended On Python Framework Crawler Open Source Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Icrawler ⭐ 792
A multi-thread crawler framework with many builtin image crawlers provided.
dependent packages 5total releases 42latest release June 30, 2023most recent commit 4 months agopypi icrawler} Downloads
Grab ⭐ 2,292
Web Scraping Framework
dependent packages 3total releases 120latest release June 24, 2018most recent commit 10 months agopypi grab} Downloads
Ant_nest ⭐ 93
Simple, clear and fast Web Crawler framework build on python3.6+, powered by asyncio.
dependent packages 1total releases 59latest release January 01, 2021most recent commit 2 years agopypi ant-nest} Downloads
The 10 Latest Releases In Python Framework Crawler Open Source Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Dude ⭐ 397
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
total releases 43latest release August 12, 2023most recent commit 3 months ago
Icrawler ⭐ 792
A multi-thread crawler framework with many builtin image crawlers provided.
dependent packages 5total releases 42latest release June 30, 2023most recent commit 4 months agopypi icrawler} Downloads
Aioscpy ⭐ 138
An asyncio + aiolibs crawler imitate scrapy framework
total releases 46latest release May 17, 2023most recent commit 5 months ago
Scrapio ⭐ 16
Asyncio web crawling framework. Work in progress.
total releases 9latest release July 09, 2022most recent commit 9 months ago
Tinycrawl ⭐ 9
Very easy and tiny crawling framework, support multithread processing.
total releases 3latest release January 12, 2021most recent commit 3 years ago
Ant_nest ⭐ 93
Simple, clear and fast Web Crawler framework build on python3.6+, powered by asyncio.
dependent packages 1total releases 59latest release January 01, 2021most recent commit 2 years agopypi ant-nest} Downloads
Ioweb ⭐ 28
Web Scraping Framework
total releases 26latest release November 19, 2020most recent commit 2 years ago
Phages2050 ⭐ 27
PHAGES2050 - a Comprehensive AI-based Framework for Phage Research & Therapy
total releases 10latest release October 11, 2020most recent commit 4 years ago
Airspider ⭐ 8
A Fast and Light Python Spider Framework 🕷️
total releases 6latest release September 02, 2020most recent commit 4 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.