| scrapy/scrapy |
49,918 |
|
4,185 |
445 |
over 2 years ago |
96 |
September 18, 2023 |
692 |
bsd-3-clause |
Python |
| Scrapy, a fast high-level web crawling & scraping framework for Python. |
| NaiboWang/EasySpider |
43,770 |
|
0 |
0 |
about 2 months ago |
0 |
|
6 |
agpl-3.0 |
JavaScript |
| A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。 |
| huginn/huginn |
40,328 |
|
69 |
52 |
over 2 years ago |
8 |
September 22, 2017 |
698 |
mit |
Ruby |
| Create agents that monitor and act on your behalf. Your agents are standing by! |
| freeCodeCamp/devdocs |
33,315 |
|
0 |
0 |
over 2 years ago |
0 |
|
173 |
mpl-2.0 |
Ruby |
| API Documentation Browser |
| iawia002/lux |
30,853 |
|
0 |
8 |
5 months ago |
40 |
November 06, 2023 |
477 |
mit |
Go |
| 👾 Fast and simple video download library and CLI tool written in Go |
| cheeriojs/cheerio |
27,372 |
|
112,614 |
20,519 |
over 2 years ago |
70 |
June 26, 2022 |
34 |
mit |
TypeScript |
| The fast, flexible, and elegant library for parsing and manipulating HTML and XML. |
| gocolly/colly |
21,443 |
|
81 |
328 |
over 2 years ago |
22 |
March 08, 2022 |
181 |
apache-2.0 |
Go |
| Elegant Scraper and Crawler Framework for Golang |
| codelucas/newspaper |
13,147 |
|
222 |
97 |
over 2 years ago |
18 |
September 28, 2018 |
498 |
mit |
Python |
| News, full-text, and article metadata extraction in Python 3. Advanced docs: |
| psf/requests-html |
13,100 |
|
0 |
0 |
about 3 years ago |
6 |
July 26, 2022 |
198 |
mit |
Python |
| Pythonic HTML Parsing for Humans™ |
| ultrafunkamsterdam/undetected-chromedriver |
12,616 |
|
0 |
100 |
11 months ago |
53 |
November 15, 2023 |
864 |
gpl-3.0 |
Python |
| Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM) |
