Project Name	Stars	Most Recent Commit	Open Issues	License	Language
Awesome Web Scraping	6,060	5 months ago	1	other	Makefile
List of libraries, tools and APIs for web scraping and data processing.
Xidel	611	5 months ago	18	gpl-3.0	Pascal
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Blinkist M4a Downloader	97	2 years ago	12	mit	Go
Grabs all of the audio files from all of the Blinkist books
Meds Processor	10	4 years ago		mit	C#
Learn C# and .NET Core by building a scraper, downloader and parser for Croatia's Health Insurance Fund primary and supplementary drugs list.
Scrapers	6	7 months ago			JavaScript
Back-end server for commercial data scrapers and analyser

Alternatives To Awesome Web Scraping

Select To Compare

Awesome Web Scraping ⭐ 6,060

List of libraries, tools and APIs for web scraping and data processing.

most recent commit 5 months ago

Xidel ⭐ 611

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

most recent commit 5 months ago

Blinkist M4a Downloader ⭐ 97

Grabs all of the audio files from all of the Blinkist books

most recent commit 2 years ago

Meds Processor ⭐ 10

Learn C# and .NET Core by building a scraper, downloader and parser for Croatia's Health Insurance Fund primary and supplementary drugs list.

most recent commit 4 years ago

Scrapers ⭐ 6

Back-end server for commercial data scrapers and analyser

most recent commit 7 months ago

Suggest An Alternative To awesome-web-scraping

Alternative Project Comparisons

Awesome Web Scraping vs Xidel

Awesome Web Scraping vs Blinkist M4a Downloader

Awesome Web Scraping vs Meds Processor

Awesome Web Scraping vs Scrapers

Popular Data Processing Projects

Miller ⭐ 8,397

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

total releases 65latest release November 26, 2022most recent commit 3 months ago

Bash Oneliner ⭐ 7,946

A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.

most recent commit 4 months ago

Dasel ⭐ 4,845

Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.

dependent packages 14total releases 97latest release November 28, 2023most recent commit 9 days ago

Dali ⭐ 4,770

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

dependent packages 4total releases 19latest release December 06, 2023most recent commit 3 months ago

Pandera ⭐ 2,807

A light-weight, flexible, and expressive statistical data testing library

dependent packages 97total releases 79latest release December 08, 2023most recent commit 3 months ago

Popular Scraper Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Huginn ⭐ 40,328

Create agents that monitor and act on your behalf. Your agents are standing by!

dependent packages 52total releases 8latest release September 22, 2017most recent commit 3 months ago

Devdocs ⭐ 33,315

API Documentation Browser

most recent commit 3 months ago

Cheerio ⭐ 27,702

The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

dependent packages 20,519total releases 70latest release June 26, 2022most recent commit 8 days ago

Lux ⭐ 24,752

👾 Fast and simple video download library and CLI tool written in Go

dependent packages 8total releases 40latest release November 06, 2023most recent commit 15 days ago

Popular Data Processing Categories