Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Html Web Crawler Open Source Projects

Open source projects categorized as Html Web Crawler
30 Days Of Python ⭐ 1,926
Learn Python for the next 30 (or so) Days.
most recent commit a year ago
Rvest ⭐ 1,434
Simple web scraping for R
dependent packages 320total releases 13most recent commit 3 months ago
How To Prevent Scraping ⭐ 1,417
The ultimate guide on preventing Website Scraping
most recent commit 4 months ago
Lectures ⭐ 1,176
Lecture notes for EC 607
most recent commit a year ago
Selectolax ⭐ 921
Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
dependent packages 42total releases 44most recent commit 3 months agopypi selectolax} Downloads
Storm Crawler ⭐ 834
A scalable, mature and versatile web crawler based on Apache Storm
dependent packages 10total releases 36most recent commit 3 months ago
Gazpacho ⭐ 716
🥫 The simple, fast, and modern web scraping library
dependent packages 8total releases 19most recent commit 4 months agopypi gazpacho} Downloads
Marginaliasearch ⭐ 711
Internet search engine for text-oriented websites. Indexing the small, old and weird web.
most recent commit 3 months ago
Xidel ⭐ 611
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
most recent commit 5 months ago
Jekyll ⭐ 498
Jekyll-based static site for The Programming Historian
most recent commit 3 months ago
Basketball_reference_web_scraper ⭐ 382
NBA Stats API via Basketball Reference
total releases 39most recent commit 3 months ago
Scrape Linkedin Selenium ⭐ 353
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
most recent commit 2 years ago
Hquery.php ⭐ 345
An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
dependent packages 4total releases 23most recent commit 3 months agonpm hquery.php} Downloads
Youtube Projects ⭐ 272
This repository contains all the code I use in my YouTube tutorials.
most recent commit 3 years ago
Football Data Collection ⭐ 246
Web Scraper used to create Kaggle European Soccer database
most recent commit 5 years ago
Daath Ai Parser ⭐ 184
Daath AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.
most recent commit 9 months ago
Nokolexbor ⭐ 149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
dependent packages 3total releases 20most recent commit 3 months agorubygems nokolexbor} Downloads
Actor Page Analyzer ⭐ 136
Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.
most recent commit a year ago
Ph Submissions ⭐ 133
The repository and website hosting the peer review process for new Programming Historian lessons
most recent commit 3 months ago
Cascadia ⭐ 128
Go cascadia package command line CSS selector
total releases 9most recent commit 10 months ago
Educative.io_scraper ⭐ 117
Educative.io Course Downloader developed using Python and Selenium. Refer Readme.md for setup instructions.
most recent commit 3 months ago
Nytcrossword ⭐ 117
An exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.
most recent commit 5 years ago
Html Metadata ⭐ 115
MetaData html scraper and parser for Node.js (supports Promises and callback style)
dependent packages 26total releases 20most recent commit 4 years agonpm html-metadata} Downloads
The 10 Most Depended On Html Web Crawler Open Source Projects
Rvest ⭐ 1,434
Simple web scraping for R
dependent packages 320total releases 13latest release August 19, 2022most recent commit 3 months ago
Selectolax ⭐ 921
Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
dependent packages 42total releases 44latest release October 17, 2023most recent commit 3 months agopypi selectolax} Downloads
Html Metadata ⭐ 115
MetaData html scraper and parser for Node.js (supports Promises and callback style)
dependent packages 26total releases 20latest release November 20, 2019most recent commit 4 years agonpm html-metadata} Downloads
Storm Crawler ⭐ 834
A scalable, mature and versatile web crawler based on Apache Storm
dependent packages 10total releases 36latest release October 25, 2023most recent commit 3 months ago
Gazpacho ⭐ 716
🥫 The simple, fast, and modern web scraping library
dependent packages 8total releases 19latest release October 09, 2020most recent commit 4 months agopypi gazpacho} Downloads
Htmldate ⭐ 101
Fast and robust date extraction from web pages, with Python or on the command-line
dependent packages 7total releases 50latest release November 21, 2023most recent commit 3 months agopypi htmldate} Downloads
Hquery.php ⭐ 345
An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
dependent packages 4total releases 23latest release July 19, 2019most recent commit 3 months agonpm hquery.php} Downloads
Selectorlib ⭐ 55
A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
dependent packages 3total releases 14latest release January 08, 2020most recent commit a year agopypi selectorlib} Downloads
Nokolexbor ⭐ 149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
dependent packages 3total releases 20latest release October 03, 2023most recent commit 3 months agorubygems nokolexbor} Downloads
Ronin Web ⭐ 40
ronin-web is a collection of useful web helper methods and commands.
dependent packages 3total releases 16latest release April 04, 2023most recent commit 4 months agorubygems ronin-web} Downloads
The 10 Latest Releases In Html Web Crawler Open Source Projects
Htmldate ⭐ 101
Fast and robust date extraction from web pages, with Python or on the command-line
dependent packages 7total releases 50latest release November 21, 2023most recent commit 3 months agopypi htmldate} Downloads
Basketball_reference_web_scraper ⭐ 382
NBA Stats API via Basketball Reference
total releases 39latest release November 14, 2023most recent commit 3 months ago
Storm Crawler ⭐ 834
A scalable, mature and versatile web crawler based on Apache Storm
dependent packages 10total releases 36latest release October 25, 2023most recent commit 3 months ago
Selectolax ⭐ 921
Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
dependent packages 42total releases 44latest release October 17, 2023most recent commit 3 months agopypi selectolax} Downloads
Nokolexbor ⭐ 149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
dependent packages 3total releases 20latest release October 03, 2023most recent commit 3 months agorubygems nokolexbor} Downloads
Cascadia ⭐ 128
Go cascadia package command line CSS selector
total releases 9latest release June 30, 2023most recent commit 10 months ago
Ronin Web ⭐ 40
ronin-web is a collection of useful web helper methods and commands.
dependent packages 3total releases 16latest release April 04, 2023most recent commit 4 months agorubygems ronin-web} Downloads
Tatooine ⭐ 78
A powerful scraper for JavaScript Developers.
dependent packages 1total releases 84latest release March 27, 2023most recent commit a year agonpm tatooine} Downloads
Node Fetch Dom ⭐ 13
Magic utility that extract javascript global variables from a remote html page.
dependent packages 2total releases 6latest release September 08, 2022most recent commit a year agonpm @stefcud/fetch-dom} Downloads
Rvest ⭐ 1,434
Simple web scraping for R
dependent packages 320total releases 13latest release August 19, 2022most recent commit 3 months ago
Popular Web User Interface Categories
Html
Reactjs
Css
Vue
Angular
Jquery
Bootstrap
Admin
Dashboard
Scss
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.