Project Name	Stars	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Instascrape	554		a year ago	56	February 05, 2021	53	mit	Python
Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically
Jekyll	498		3 months ago			14		HTML
Jekyll-based static site for The Programming Historian
Pulsarrpa	413	3	4 months ago	58	November 11, 2023	24	agpl-3.0	Kotlin
Automate webpages at scale, scrape web data completely and accurately with high performance, distributed RPA.
Lagoujob	250		5 years ago				apache-2.0	Python
Job data mining repo for lagou.com
Tradingview Data Scraper	250		3 years ago			11	apache-2.0	Python
Extract price and indicator data from TradingView charts to create ML datasets
Ayakashi	177	2	10 months ago	40	June 29, 2023	8	other	TypeScript
:zap: Ayakashi.io - The next generation web scraping framework
Evine	117		3 years ago	8	August 01, 2020		gpl-3.0	Go
Interactive CLI Web Crawler
Goodreadsscraper	76		a year ago			3	mit	Python
Scrape data from Goodreads using Scrapy and Selenium :books:
Amazon_scraper	64	2	4 months ago	13	June 10, 2022	2		JavaScript
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Webreaper	59		5 months ago	17	August 15, 2023	2	gpl-3.0	C#
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

Alternatives To Wgit

Select To Compare

Instascrape ⭐ 554

Powerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically

total releases 56most recent commit a year ago

Jekyll ⭐ 498

Jekyll-based static site for The Programming Historian

most recent commit 3 months ago

Pulsarrpa ⭐ 413

Automate webpages at scale, scrape web data completely and accurately with high performance, distributed RPA.

dependent packages 3total releases 58most recent commit 4 months ago

Lagoujob ⭐ 250

Job data mining repo for lagou.com

most recent commit 5 years ago

Tradingview Data Scraper ⭐ 250

Extract price and indicator data from TradingView charts to create ML datasets

most recent commit 3 years ago

Ayakashi ⭐ 177

:zap: Ayakashi.io - The next generation web scraping framework

dependent packages 2total releases 40most recent commit 10 months ago

Evine ⭐ 117

Interactive CLI Web Crawler

total releases 8most recent commit 3 years ago

Goodreadsscraper ⭐ 76

Scrape data from Goodreads using Scrapy and Selenium :books:

most recent commit a year ago

Amazon_scraper ⭐ 64

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

dependent packages 2total releases 13most recent commit 4 months ago

npm @scrapingant/amazon-proxy-scraper} Downloads

Webreaper ⭐ 59

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

total releases 17most recent commit 5 months ago

Suggest An Alternative To wgit

Alternative Project Comparisons

Wgit vs Tradingview Data Scraper

Wgit vs Ayakashi

Wgit vs Evine

Wgit vs Goodreadsscraper

Wgit vs Amazon_scraper

Wgit vs Webreaper

Popular Web Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Huginn ⭐ 41,465

Create agents that monitor and act on your behalf. Your agents are standing by!

dependent packages 52total releases 8latest release September 22, 2017most recent commit 23 days ago

Changedetection.io ⭐ 13,943

The best and simplest free open source website change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply monitor which websites had a text change for free. Free Open source web page change detection, Website defacement monitoring, Price change notification

most recent commit 3 months ago

Crawlee ⭐ 12,158

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747latest release December 10, 2023most recent commit 4 days ago

Crawlab ⭐ 10,521

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

total releases 1latest release March 03, 2019most recent commit 4 months ago

Popular Data Mining Projects

Ml From Scratch ⭐ 23,095

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

total releases 4latest release June 17, 2017most recent commit 7 months ago

Awesome Datascience ⭐ 23,007

:memo: An awesome Data Science repository to learn and apply for real world problems.

most recent commit 24 days ago

Easyocr ⭐ 20,438

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

dependent packages 69total releases 32latest release September 04, 2023most recent commit 4 months ago

Lightgbm ⭐ 16,056

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

dependent packages 574total releases 34latest release September 12, 2023most recent commit 4 days ago

Awesome Production Machine Learning ⭐ 15,804

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

most recent commit a month ago

Popular Data Processing Categories