Awesome Open Source

Programming Languages

The Top 23 Html Scrape Open Source Projects

Open source projects categorized as Html Scrape

Categories > Web User Interface > Html

Categories > Scrape

Metascraper ⭐ 2,189

Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.

dependent packages 97total releases 290most recent commit 3 months ago

npm metascraper} Downloads

Scrapely ⭐ 1,668

A pure-python HTML screen-scraping library

dependent packages 2total releases 13most recent commit 4 years ago

pypi scrapely} Downloads

Upton ⭐ 1,615

A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)

dependent packages 1total releases 20most recent commit 5 years ago

rubygems upton} Downloads

How To Prevent Scraping ⭐ 1,417

The ultimate guide on preventing Website Scraping

most recent commit 4 months ago

Mlscraper ⭐ 935

🤖 Scrape data from HTML websites automatically by just providing examples

total releases 4most recent commit a year ago

Skrape.it ⭐ 714

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

dependent packages 3total releases 14most recent commit 4 months ago

Se Scraper ⭐ 477

Javascript scraping module based on puppeteer for many different search engines...

dependent packages 1total releases 68most recent commit 2 years ago

npm se-scraper} Downloads

Scrape Linkedin Selenium ⭐ 353

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

most recent commit 2 years ago

Elixir Scrape ⭐ 300

Scrape any website, article or RSS/Atom Feed with ease!

dependent packages 1total releases 25most recent commit 4 years ago

hex scrape} Downloads

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

total releases 2most recent commit 3 years ago

Scrape a website efficiently, block by block, page by page. Based on cheerio and curl.

dependent packages 3total releases 7most recent commit 7 years ago

npm cheers} Downloads

Scrape Linkedin ⭐ 132

Scrape a public LinkedIn profile.

most recent commit 6 years ago

Unofficial Jisho Api ⭐ 120

Encapsulates the official Jisho.org API and also provides kanji, example, and stroke diagram search.

dependent packages 3total releases 42most recent commit 3 months ago

npm unofficial-jisho-api} Downloads

Youtube Scrape ⭐ 113

Scrape YouTube searches (API)

most recent commit 3 years ago

Html2rss ⭐ 106

📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.

total releases 20most recent commit 4 months ago

Web Scraper ⭐ 97

Perl web scraping toolkit

dependent packages 52total releases 38most recent commit 7 years ago

Daily Scraper ⭐ 93

Fetches information about every webpage 🤖

most recent commit 7 months ago

Meteor Scrape ⭐ 73

Scrape any Website or RSS/Atom-Feed with ease.

total releases 2most recent commit 9 years ago

Laravel Intelligent Scraper ⭐ 72

Service to scrape a web page easily without knowing their HTML structure.

total releases 20most recent commit 2 years ago

Stack Scraper ⭐ 61

dependent packages 1total releases 4most recent commit 5 months ago

npm stack-scraper} Downloads

A web scraping framework for .NET

total releases 11most recent commit 3 months ago

Social Builder ⭐ 57

most recent commit 9 years ago

Page Compare ⭐ 49

Simple heuristic for measuring web page similarity (& data set)

most recent commit 6 years ago

The 10 Most Depended On Html Scrape Open Source Projects

Metascraper ⭐ 2,189

Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.

dependent packages 97total releases 290latest release December 07, 2023most recent commit 3 months ago

npm metascraper} Downloads

Web Scraper ⭐ 97

Perl web scraping toolkit

dependent packages 52total releases 38latest release October 20, 2014most recent commit 7 years ago

Extractor Js ⭐ 26

Since I originally wrote this a module called request has come on the scene. You might want to try that before mucking about with extractor-js. A small NodeJS package using jsDom to facilite screen scraping and spidering. It scrapes single and multiple elements and includes support for many tag attributes.

dependent packages 5total releases 20latest release September 11, 2012most recent commit 8 years ago

npm extractor} Downloads

Node Linkscrape ⭐ 16

A Node.js module to scrape and normalize links from an HTML string.

dependent packages 4total releases 4latest release April 01, 2015most recent commit 9 years ago

npm linkscrape} Downloads

Skrape.it ⭐ 714

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

dependent packages 3total releases 14latest release July 19, 2022most recent commit 4 months ago

Scrape websites simply in Node.js. Streaming HTML scraper using CSS selectors.

dependent packages 3total releases 3latest release January 09, 2014most recent commit 10 years ago

npm skim} Downloads

Unofficial Jisho Api ⭐ 120

Encapsulates the official Jisho.org API and also provides kanji, example, and stroke diagram search.

dependent packages 3total releases 42latest release November 10, 2023most recent commit 3 months ago

npm unofficial-jisho-api} Downloads

Scrape a website efficiently, block by block, page by page. Based on cheerio and curl.

dependent packages 3total releases 7latest release October 27, 2015most recent commit 7 years ago

npm cheers} Downloads

Scrapely ⭐ 1,668

A pure-python HTML screen-scraping library

dependent packages 2total releases 13latest release November 28, 2019most recent commit 4 years ago

pypi scrapely} Downloads

Scrape Markdown ⭐ 13

A simple utility for scraping web pages and returning the results in Markdown.

dependent packages 1total releases 1latest release January 08, 2014most recent commit 7 years ago

npm scrape-markdown} Downloads

The 10 Latest Releases In Html Scrape Open Source Projects

Metascraper ⭐ 2,189

Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.

dependent packages 97total releases 290latest release December 07, 2023most recent commit 3 months ago

npm metascraper} Downloads

Unofficial Jisho Api ⭐ 120

Encapsulates the official Jisho.org API and also provides kanji, example, and stroke diagram search.

dependent packages 3total releases 42latest release November 10, 2023most recent commit 3 months ago

npm unofficial-jisho-api} Downloads

Stack Scraper ⭐ 61

dependent packages 1total releases 4latest release November 05, 2023most recent commit 5 months ago

npm stack-scraper} Downloads

Scrape Schema Recipe ⭐ 44

Scrapes recipes from HTML https://schema.org/Recipe (Microdata/JSON-LD) into Python dictionaries.

total releases 13latest release September 26, 2023most recent commit 7 months ago

Skrape.it ⭐ 714

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

dependent packages 3total releases 14latest release July 19, 2022most recent commit 4 months ago

Puppeteer Table Parser ⭐ 20

Scrape and parse HTML tables with the Puppeteer table parser.

total releases 15latest release July 05, 2022most recent commit 3 months ago

Mlscraper ⭐ 935

🤖 Scrape data from HTML websites automatically by just providing examples

total releases 4latest release June 24, 2022most recent commit a year ago

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

total releases 2latest release September 02, 2021most recent commit 3 years ago

Email Scraper ⭐ 11

Simple Python library to scrape email addresses from HTML

total releases 4latest release March 24, 2021most recent commit 3 years ago

Scraper More Faster ⭐ 10

A PHP Web Scraper - Designed for Speed

latest release November 24, 2020most recent commit 10 years ago

Popular Web User Interface Categories

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.