Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Request Spider Open Source Projects

Open source projects categorized as Request Spider
Categories > Networking > Request
Decryptlogin ⭐ 2,375
DecryptLogin: APIs for loginning some websites by using requests.
dependent packages 4total releases 49most recent commit 2 years agopypi DecryptLogin} Downloads
Grab ⭐ 2,292
Web Scraping Framework
dependent packages 3total releases 120most recent commit 10 months agopypi grab} Downloads
Geziyor ⭐ 1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
dependent packages 11total releases 6most recent commit a year ago
Go_spider ⭐ 1,629
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
dependent packages 2total releases 1most recent commit 6 years ago
Checkinpanel ⭐ 1,175
一个主要运行在 𝐞𝐥𝐞𝐜𝐕𝟐𝐏 或 𝐪𝐢𝐧𝐠𝐥𝐨𝐧𝐠 等定时面板，同时支持系统运行环境的签到项目（环境：𝑷𝒚𝒕𝒉𝒐𝒏 3.8+ / 𝑵𝒐𝒅𝒆.𝒋𝒔 10+ / 𝑩𝒂𝒔𝒉 4+ / 𝑶𝒑𝒆𝒏𝑱𝑫𝑲8 / 𝑷𝒆𝒓𝒍5）
most recent commit a year ago
Reptile ⭐ 1,081
🏀 Python3 网络爬虫实战（部分含详细教程）猫眼 腾讯视频 豆瓣 研招网 微博 笔趣阁小说 百度热点 B站 CSDN 网易云阅读 阿里文学 百度股票 今日头条 微信公众号 网易云音乐 拉勾 有道 unsplash 实习僧 汽车之家 英雄联盟盒子 大众点评 链家 LPL赛程 台风 梦幻西游、阴阳师藏宝阁 天气 牛客网 百度文库 睡前故事 知乎 Wish
most recent commit 3 years ago
Bilili ⭐ 999
🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器
total releases 68most recent commit 3 months ago
Spider_python ⭐ 732
python爬虫
most recent commit a year ago
Python Fxxk Spider ⭐ 571
收集各种免费的 Python 爬虫项目
most recent commit 5 months ago
Alltheplaces ⭐ 502
A set of spiders and scrapers to extract location information from places that post their location on the internet.
most recent commit 3 months ago
Webspider ⭐ 356
A website of IT position data & analysis, helps you to get a better understanding of the requirements and trends of the IT job market
most recent commit 8 months ago
Sasila ⭐ 264
一个灵活、友好的爬虫框架
total releases 17most recent commit 5 years ago
Scrapy Deltafetch ⭐ 232
Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
total releases 9most recent commit 3 years ago
Infinitycrawler ⭐ 221
A simple but powerful web crawler library for .NET
total releases 7most recent commit 8 months ago
Spider_reverse ⭐ 178
爬虫逆向案例，已完成：震坤行 | 网易易盾 | 微信小程序反编译逆向(百达星系) | 同花顺 | rpc解密 | 加速乐 | 极验滑块验证码 | 巨量算数 | Boss直聘 | 企查查 | 中国五矿 | qq音乐 | 产业政策大数据平台 | 企知道 | 雪球网(acw_sc__v2) | 1688 | 七麦数据 | whggzy | 企名科技 | mohurd | 艺恩数据 | 欧科云链
most recent commit 5 months ago
Not Your Average Web Crawler ⭐ 130
A web crawler (for bug hunting) that gathers more than you can imagine.
total releases 36most recent commit 2 years ago
Zhihu Spider ⭐ 128
一个获取知乎用户主页信息的多线程Python爬虫程序。
most recent commit 5 years ago
Abotx ⭐ 106
Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
most recent commit 7 months ago
Moivesspider ⭐ 105
爬取电影天堂的电影爬虫
most recent commit 6 years ago
Bilibili_member_crawler ⭐ 98
B站用户爬虫 好耶~是爬虫
most recent commit 5 years ago
New_xxt ⭐ 84
学习通,泛雅，超星尔雅，无需浏览器，直接运行（已打包为exe），支持批量导出答案，多用户批量完成作业
most recent commit 5 months ago
Gospider ⭐ 82
🚀Gospider is a powerful Golang web crawler that includes all the necessary libraries for transitioning from Python to Golang. It provides a fast and seamless transition for Python web crawlers to Golang.
most recent commit 7 months ago
Boris Spider ⭐ 75
boris-spider是一款使用Python语言编写的爬虫框架，于多年的爬虫业务中不断磨合而诞生，
total releases 18most recent commit 3 years ago
The 7 Most Depended On Request Spider Open Source Projects
Seenreq ⭐ 32
Generate an object for testing if a request is sent, request is Mikeal's request.
dependent packages 11total releases 26latest release April 15, 2019most recent commit 5 years agonpm seenreq} Downloads
Geziyor ⭐ 1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
dependent packages 11total releases 6latest release April 19, 2021most recent commit a year ago
Decryptlogin ⭐ 2,375
DecryptLogin: APIs for loginning some websites by using requests.
dependent packages 4total releases 49latest release August 29, 2022most recent commit 2 years agopypi DecryptLogin} Downloads
Grab ⭐ 2,292
Web Scraping Framework
dependent packages 3total releases 120latest release June 24, 2018most recent commit 10 months agopypi grab} Downloads
Marmot ⭐ 18
💐Marmot A Golang HTTP Download
dependent packages 2total releases 13latest release November 25, 2022most recent commit a year ago
Scrapy Puppeteer ⭐ 45
Library that helps use puppeteer in scrapy.
dependent packages 1total releases 10latest release September 11, 2023most recent commit 4 months agopypi scrapy-puppeteer-client} Downloads
The 10 Latest Releases In Request Spider Open Source Projects
Scrapy Puppeteer ⭐ 45
Library that helps use puppeteer in scrapy.
dependent packages 1total releases 10latest release September 11, 2023most recent commit 4 months agopypi scrapy-puppeteer-client} Downloads
Marmot ⭐ 18
💐Marmot A Golang HTTP Download
dependent packages 2total releases 13latest release November 25, 2022most recent commit a year ago
Scrapy Frontera ⭐ 31
More flexible and featured Frontera scheduler for Scrapy
total releases 10latest release November 16, 2022most recent commit a year ago
Decryptlogin ⭐ 2,375
DecryptLogin: APIs for loginning some websites by using requests.
dependent packages 4total releases 49latest release August 29, 2022most recent commit 2 years agopypi DecryptLogin} Downloads
Infinitycrawler ⭐ 221
A simple but powerful web crawler library for .NET
total releases 7latest release August 10, 2022most recent commit 8 months ago
Quick ⭐ 6
HTTP Request library for Go (简洁高效的HTTP请求库)
total releases 13latest release February 15, 2022most recent commit a year ago
Scrapy Autoextract ⭐ 39
Zyte Automatic Extraction integration for Scrapy
total releases 11latest release August 05, 2021most recent commit 2 years ago
Geziyor ⭐ 1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
dependent packages 11total releases 6latest release April 19, 2021most recent commit a year ago
Popular Networking Categories
Server
Network
Http
Proxy
Port
Email
Websocket
Hosts
Router
Upload
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.