Awesome Open Source

Programming Languages

Search results for html scrape

90 search results found

Metascraper ⭐ 2,189

Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.

Scrapely ⭐ 1,668

A pure-python HTML screen-scraping library

Upton ⭐ 1,615

A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)

How To Prevent Scraping ⭐ 1,417

The ultimate guide on preventing Website Scraping

Mlscraper ⭐ 935

🤖 Scrape data from HTML websites automatically by just providing examples

Skrape.it ⭐ 714

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Se Scraper ⭐ 477

Javascript scraping module based on puppeteer for many different search engines...

Scrape Linkedin Selenium ⭐ 353

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Elixir Scrape ⭐ 300

Scrape any website, article or RSS/Atom Feed with ease!

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

Scrape a website efficiently, block by block, page by page. Based on cheerio and curl.

Scrape Linkedin ⭐ 132

Scrape a public LinkedIn profile.

Unofficial Jisho Api ⭐ 120

Encapsulates the official Jisho.org API and also provides kanji, example, and stroke diagram search.

Youtube Scrape ⭐ 113

Scrape YouTube searches (API)

Html2rss ⭐ 106

📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.

Web Scraper ⭐ 97

Perl web scraping toolkit

Daily Scraper ⭐ 93

Fetches information about every webpage 🤖

Meteor Scrape ⭐ 73

Scrape any Website or RSS/Atom-Feed with ease.

Laravel Intelligent Scraper ⭐ 72

Service to scrape a web page easily without knowing their HTML structure.

Stack Scraper ⭐ 61

A web scraping framework for .NET

Social Builder ⭐ 57

Page Compare ⭐ 49

Simple heuristic for measuring web page similarity (& data set)

Ransomware.live ⭐ 49

🏴‍☠️💰 Another Ransomware gang tracker

Kindle Your Highlights ⭐ 45

Scrape highlights from kindle.amazon.com

Scrape Schema Recipe ⭐ 44

Scrapes recipes from HTML https://schema.org/Recipe (Microdata/JSON-LD) into Python dictionaries.

Searchscraperapi ⭐ 41

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

Tvseries ⭐ 36

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.

Readability Cli ⭐ 35

A CLI for Mozilla Readability. Get clean, uncluttered, ready-to-read HTML from any webpage!

Scrape Metadata ⭐ 32

📜 HTML metadata scraper

Wandering Labs Availability 2 ⭐ 27

Screen scrapes popular campground reservation website looking for availabilities.

Geoip Scraper ⭐ 27

Scrapes specified files, generating a pretty google powered map with geoip results

Kotlin DSL to scrape HTML and convert it to JSON

Extractor Js ⭐ 26

Since I originally wrote this a module called request has come on the scene. You might want to try that before mucking about with extractor-js. A small NodeJS package using jsDom to facilite screen scraping and spidering. It scrapes single and multiple elements and includes support for many tag attributes.

Scrape websites simply in Node.js. Streaming HTML scraper using CSS selectors.

Wattpad2epub ⭐ 24

Python Script to Scrape Wattpad Story and convert to Epub and html file. Easiest to use.

Cookcountyjail2 ⭐ 24

A new version of the cook county jail scraper, inspired by the Supreme Chi-Town Coding Crew

For scraping content out of pages and/or feeds.

Web Scraping ⭐ 20

short tutorial on how to scrape the internets

Puppeteer Table Parser ⭐ 20

Scrape and parse HTML tables with the Puppeteer table parser.

Flatfish ⭐ 20

Anki Deck Scraper ⭐ 19

Scrape all shared anki decks

Scrapy_facebooker ⭐ 17

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Node Linkscrape ⭐ 16

A Node.js module to scrape and normalize links from an HTML string.

Image Scraper ⭐ 15

Python script to scrap images from a website

Web Scraping Machine Learning ⭐ 14

Scrapinode ⭐ 14

content driven and route based scraper

Scavenger ⭐ 14

Scrape and take screenshots of dynamic and static webpages

Scrape Markdown ⭐ 13

A simple utility for scraping web pages and returning the results in Markdown.

Presidencyproject ⭐ 13

Code to scrape and parse documents in The American Presidency Project

Nitter_scraper ⭐ 13

Scrape Twitter API without authentication using Nitter.

Covid 19 Malaysia ⭐ 12

Covid-19 in Malaysia

Web Link Tester ⭐ 11

Flask App to scrape hrefs from websites and validate links

Cloujera ⭐ 11

Full text search for coursera

Email Scraper ⭐ 11

Simple Python library to scrape email addresses from HTML

Cross-platform HTML and XML parser written in Swift

Otvoreni Akti ⭐ 10

A better search engine for the City of Zagreb decrees

Scraper More Faster ⭐ 10

A PHP Web Scraper - Designed for Speed

Spideyscrape ⭐ 10

a quick scraper-spider for offline reading of documents organized in annoying "html book" format

Bitcointalk Ann ⭐ 10

Scrapes 1000+ thread into a single html document for better reading and analysis

Web Scraping Projects ⭐ 10

List of my scraping projects

Ragstoriches ⭐ 9

Develop highly-concurrent web scrapers, easily.

This project aims to scrape a Saturday Night Live database from the web

Page To Html Converter ⭐ 8

An app that scrapes a url and return the page's HTML source, without including HTML presentation attributes

Chromedriver Heroku ⭐ 8

Web scraping with Selenium Webdriver and MongoDB, deployed to Heroku

Covid19 Gto ⭐ 8

[WIP] Repository that scrapes and cleans data from: https://coronavirus.guanajuato.gob.mx/

Stockrank ⭐ 8

Python implementation of Joel Greenblatt's 'magic formula' for the ASX.

Meteor Demo Data In Mongodb ⭐ 7

Scrape 5000 lines of HTML and add to mongdb with Meteor JS

Delicious_scraper ⭐ 7

little ruby script to scrape delicious bookmarks

Phinstagram ⭐ 7

A simple PHP script that scrapes the instagram.com/username profile page giving you the JSON data available.

Pointsunknown.github.io ⭐ 6

Github Api ⭐ 6

🐍A python ⚗️flask API project which user 🍵beautifulsoup to scrape github and get the user repositories and return as JSON.

Geekhack Scraper ⭐ 6

Scrapes Group Buy information off of geekhack.org. It scrapes thread related information as well as all the images from the thread starter.

Community Court Pdf Scraper ⭐ 6

Scrapes a 1,200-page PDF from the City of Eugene into a structured dataset.

Wattpadtoebook ⭐ 6

Python script to web-scrape Wattpad Books and prepare a HTML file of the book

Data_science_r_projects ⭐ 6

Contains examples of projects I've done using R

Simple API for Scraping HTML via Sinatra and Wombat

Cortlandt ⭐ 5

Solves your flat hunting problems in London

Jobmine Android ⭐ 5

A really basic jobmine viewer for android, uses HTML parsing to scrape all applications, as well as job details from the Jobmine site

Opencourt ⭐ 5

This is a repo for a python scraper to build a corpus of U.S. Supreme Court Cases and then build a network graph from the citations. While not scalable for the full corpus, the repo also includes some server-side D3.js rendering for the resulting graph json.

Monscrape ⭐ 5

The Set of Scrapers used to scrape data off the Monash Handbooks for the First PoC for MonPlan

Webscraping ⭐ 5

Tutorial and worked example for webscraping in python using urlopen from urllib.request, beautifulsoup, and pandas

Html Scrapper Streamlit Google Colab ⭐ 5

Easiest way to scrape HTML Tables using Python, Streamlit, Google Colab and ngrok

Phone Code Names ⭐ 5

Map of phone code names to actual names combined with lineageos data

Eviction Hearing Parser ⭐ 5

parse registers of actions for eviction hearings in Texas counties

Nyc Doffer ⭐ 5

Experiments with scraping the NYC DOF website.

Css_parser ⭐ 5

hpricot helper that scrapes html easily by parser class defined css selector

A handy little library to scrape the first and second page of hacker news

Predicting Condominium Price Using Data From Webscraping ⭐ 5

Scrape Bangkok condominium listing from hipflat.com and compare ML performance

Grammarly Selenium Automation ⭐ 5

Grammarly Automation using Selenium.

Related Searches

Javascript Html (53,392)

Html Css (19,526)

Python Html (6,892)

Html Bootstrap (5,651)

Php Html (5,615)

Html Theme (5,550)

Html Jekyll (5,387)

Html Jquery (5,205)

Html Markdown (5,082)

Html Reactjs (4,782)

1-90 of 90 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.