Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Parser Web Crawler Open Source Projects

Open source projects categorized as Parser Web Crawler
Categories > Data Processing > Web Crawler
Hakrawler ⭐ 4,120
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
total releases 11most recent commit 3 months ago
Snoop ⭐ 2,530
Snoop — инструмент разведки на основе открытых данных (OSINT world)
most recent commit 3 months ago
Abot ⭐ 1,991
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
dependent packages 8total releases 153most recent commit 2 years agonuget Abot} Downloads
Selectolax ⭐ 921
Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
dependent packages 42total releases 44most recent commit 3 months agopypi selectolax} Downloads
Hquery.php ⭐ 345
An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
dependent packages 4total releases 23most recent commit 3 months agonpm hquery.php} Downloads
Crawler Commons ⭐ 217
A set of reusable Java components that implement functionality common to any web crawler
dependent packages 7total releases 10most recent commit 5 months ago
Daath Ai Parser ⭐ 184
Daath AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.
most recent commit 9 months ago
Nokolexbor ⭐ 149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
dependent packages 3total releases 20most recent commit 3 months agorubygems nokolexbor} Downloads
Web Database Analytics ⭐ 144
Web scrapping and related analytics using Python tools
most recent commit 4 years ago
Direct_web_spider ⭐ 143
A direct web spider framworks for Ruby
most recent commit 5 years ago
Save For Offline ⭐ 118
Android app for saving webpages for offline reading.
most recent commit 3 years ago
Htmldate ⭐ 101
Fast and robust date extraction from web pages, with Python or on the command-line
dependent packages 7total releases 50most recent commit 3 months agopypi htmldate} Downloads
Reader ⭐ 100
Extract clean(er), readable text from web pages via Mercury Web Parser.
most recent commit 3 months ago
Terpene Profile Parser For Cannabis Strains ⭐ 93
Parser and database to index the terpene profile of different strains of Cannabis from online databases
most recent commit a year ago
Cianparser ⭐ 83
Parser general information on the cian.ru website / Сбор данных с сайта объявлений Циан
total releases 32most recent commit 3 months ago
Newspaperjs ⭐ 63
News extraction and scraping. Article Parsing
dependent packages 2total releases 7most recent commit a year agonpm newspaperjs} Downloads
Webreaper ⭐ 59
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
total releases 17most recent commit 5 months ago
Metacritic_api ⭐ 52
PHP Metacritic API - Mirror from my GitLab
most recent commit a year ago
Lead Generation ⭐ 46
Python script, which empowers people with no programming background to generate robust leads on a mass scale. This repo will be compiled of various versatile techniques used in lead generation.
most recent commit 3 months ago
Yellowpages Scraper ⭐ 43
Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
most recent commit 3 years ago
Wpcrawler ⭐ 43
a web crawler for single WordPress site
most recent commit 10 years ago
Scrapegen ⭐ 20
A simple python tool that generates a requests/bs4 based web scraper
most recent commit 2 years ago
Parsemycf Contest ⭐ 19
A personal submission codeforces parser for CF, parsed by individual contests.The user is prompted for the username and has the flexibilty to parse last 'n' contests he participated in CF.
most recent commit 3 years ago
The 9 Most Depended On Parser Web Crawler Open Source Projects
Selectolax ⭐ 921
Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
dependent packages 42total releases 44latest release October 17, 2023most recent commit 3 months agopypi selectolax} Downloads
Abot ⭐ 1,991
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
dependent packages 8total releases 153latest release August 09, 2021most recent commit 2 years agonuget Abot} Downloads
Crawler Commons ⭐ 217
A set of reusable Java components that implement functionality common to any web crawler
dependent packages 7total releases 10latest release July 13, 2023most recent commit 5 months ago
Node Krawler ⭐ 13
Fast and lightweight web crawler with built-in cheerio, xml and json parser.
dependent packages 7total releases 10latest release June 23, 2014most recent commit 10 years agonpm krawler} Downloads
Htmldate ⭐ 101
Fast and robust date extraction from web pages, with Python or on the command-line
dependent packages 7total releases 50latest release November 21, 2023most recent commit 3 months agopypi htmldate} Downloads
Pywikihow ⭐ 10
scrap wiki how for info
dependent packages 5total releases 11latest release July 05, 2020most recent commit 4 years agopypi pywikihow} Downloads
Hquery.php ⭐ 345
An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
dependent packages 4total releases 23latest release July 19, 2019most recent commit 3 months agonpm hquery.php} Downloads
Nokolexbor ⭐ 149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
dependent packages 3total releases 20latest release October 03, 2023most recent commit 3 months agorubygems nokolexbor} Downloads
Newspaperjs ⭐ 63
News extraction and scraping. Article Parsing
dependent packages 2total releases 7latest release May 16, 2020most recent commit a year agonpm newspaperjs} Downloads
The 10 Latest Releases In Parser Web Crawler Open Source Projects
Htmldate ⭐ 101
Fast and robust date extraction from web pages, with Python or on the command-line
dependent packages 7total releases 50latest release November 21, 2023most recent commit 3 months agopypi htmldate} Downloads
Selectolax ⭐ 921
Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
dependent packages 42total releases 44latest release October 17, 2023most recent commit 3 months agopypi selectolax} Downloads
Nokolexbor ⭐ 149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
dependent packages 3total releases 20latest release October 03, 2023most recent commit 3 months agorubygems nokolexbor} Downloads
Crawler Commons ⭐ 217
A set of reusable Java components that implement functionality common to any web crawler
dependent packages 7total releases 10latest release July 13, 2023most recent commit 5 months ago
Abot ⭐ 1,991
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
dependent packages 8total releases 153latest release August 09, 2021most recent commit 2 years agonuget Abot} Downloads
Pywikihow ⭐ 10
scrap wiki how for info
dependent packages 5total releases 11latest release July 05, 2020most recent commit 4 years agopypi pywikihow} Downloads
Newspaperjs ⭐ 63
News extraction and scraping. Article Parsing
dependent packages 2total releases 7latest release May 16, 2020most recent commit a year agonpm newspaperjs} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.