Awesome Open Source

Programming Languages

Search results for scrape

1,397 search results found

Letterboxd_recommendations ⭐ 190

Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username

Portia Dashboard ⭐ 190

portia-dashboard is a visual web crawler based on scrapinghub/portia

Scrapyz ⭐ 188

"Scrape Easy" - an extension of the Scrapy framework.

Scrapy Samples ⭐ 183

Scrapy examples crawling Craigslist

Instagram Follower Scraper ⭐ 181

Scrapes all the data of followers of any instagram account

Cloudflare Exporter ⭐ 175

Prometheus CloudFlare Exporter

Link Preview Generator ⭐ 171

Get preview data (a title, description, image, domain name) from a url. Library uses puppeteer headless browser to scrape the web site.

Atp World Tour Tennis Data ⭐ 162

Using Python to scrape ATP World Tour tennis data

Demeter ⭐ 162

Demeter is a tool for scraping the calibre web ui

Instagram Screen Scrape ⭐ 162

scrape public instagram data w/out API access

Prometheus To Cloudwatch ⭐ 159

Utility for scraping Prometheus metrics from a Prometheus client endpoint and publishing them to CloudWatch

Worm Scraper ⭐ 158

Scrapes the web serial Worm and its sequel Ward into an eBook format

Nginx_exporter ⭐ 153

Simple server that scrapes nginx stats and exports them via HTTP for Prometheus consumption

Media Scraper ⭐ 150

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

Hncrawl ⭐ 150

A scrapy-based Hacker News crawler.

Laravel Scavenger ⭐ 150

The most integrated web scraper package for Laravel.

Scrapy Webdriver ⭐ 147

Inputscanner ⭐ 147

ralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

Google Search ⭐ 142

scrape google search results

News Fetch ⭐ 140

A Python Package which helps to scrape all news details from any news websites

Telegram Channel Scraper ⭐ 137

Scrape messages from Telegram in a NodeJS cli program

Pg_exporter ⭐ 135

postgres exporter for prometheus

a command-line web scraping tool

Hockey Scraper ⭐ 134

Python Package for scraping NHL Play-by-Play and Shift data

Tumblr Downloader ⭐ 133

A command-line program that scrapes tumblr blogs, and downloads images and videos from several at once.

Scrape Linkedin ⭐ 132

Scrape a public LinkedIn profile.

Pentest_scripts ⭐ 129

penetration testing scripts

Paperscraper ⭐ 128

Tools to scrape publication metadata from pubmed, arxiv, medrxiv and chemrxiv.

Grawler ⭐ 128

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.

Phone Specs Api ⭐ 126

Phone specifications API

Youtube Like Predictor ⭐ 126

YouTube Like Count Predictions using Machine Learning

Dorkscanner ⭐ 125

A typical search engine dork scanner scrapes search engines with dorks that you provide in order to find vulnerable URLs.

Artifactory_exporter ⭐ 125

JFrog Artifactory Prometheus Exporter written in Go

Node Metainspector ⭐ 124

Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainspector Ruby gem

Ao3scraper ⭐ 123

A Python scraper for getting fan fiction content and metadata from Archive of Our Own.

Gsoc Organisation Scraper ⭐ 120

Scrape GSoC organisations using a single script.

Unofficial Jisho Api ⭐ 120

Encapsulates the official Jisho.org API and also provides kanji, example, and stroke diagram search.

Basketballcrawler ⭐ 117

This is a python module to scrape basketball-reference.com and convert various stats into usable data structures for analysis

Fitzroy ⭐ 117

A set of functions to easily access AFL data

Geeksforgeeksscrapper ⭐ 116

Scrapes g4g and creates PDF

Instagram Python Scraper ⭐ 116

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!

Trackback_scraper ⭐ 116

Fitbitscraper ⭐ 115

R package to scrape fitbit data

Js Scan ⭐ 115

a .js scanner, built in php. designed to scrape urls and other info

Twitter Scrape ⭐ 113

Download streaming tweets that match specific keywords, and dump the results to a file.

Esri2sf ⭐ 113

Scrape features from ArcGIS Server REST API and create simple features dataframe

Youtube Scrape ⭐ 113

Scrape YouTube searches (API)

Nut_exporter ⭐ 112

Network UPS Tools Prometheus Exporter

Jimutmap ⭐ 112

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.

Linkedinscraper ⭐ 112

Scrapes public information off of LinkedIn

Giggity ⭐ 110

Wraps github api for openly available information about an organization, user, or repo

Pastepwn ⭐ 109

Python framework to scrape Pastebin pastes and analyze them

Fb_scrape_public ⭐ 107

Scrapes posts and comments from public Facebook pages.

Html2rss ⭐ 106

📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.

Scraper ⭐ 104

Web scraper for scraping, tracking and visualizing prices of products on various websites.

Gesetze Tools ⭐ 103

Scripts to maintain German law git repository

Reactriot2017 Dotamania ⭐ 101

🌐 Web scraping made easy with the visual 🗺 mind map editor to JSON

Big Cases ⭐ 99

The basic code behind the @big_cases Twitter bot

Durablefunctions Apiscraping Dotnet ⭐ 98

Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

Readable Proxy ⭐ 97

Node proxy server attempting to fetch readable contents from any provided URL.

Web Scraper ⭐ 97

Perl web scraping toolkit

Vsco Scraper ⭐ 96

Easily allows for scraping a VSCO

Scrapemark ⭐ 94

Super-convenient web scraping in Python

Scraperboard ⭐ 94

Golang library to easily scrape websites based on simple XML declarations

Daily Scraper ⭐ 93

Fetches information about every webpage 🤖

A library use jQuery like API for html parsing & node selecting & node mutation, suitable for web scraping and html confusion.

Scrape Youtube ⭐ 92

A lightning fast package to scrape YouTube search results

Snapchat Map Scraper ⭐ 92

Open-source Ethereum data scraper and indexer developed by Alethio

Scrape/Parse Pastebin using GO and expression grammar (PEG)

Facebook Post Scraper ⭐ 89

Facebook Post Scraper 🕵️🖱️

Glassdoor Review Scraper ⭐ 88

Scrape reviews from Glassdoor

Funda Scraper ⭐ 88

Scraper of the Dutch real estate website www.funda.nl, implemented in Python with Scrapy

🕷️ The PHP SERP Spider - A search engine scraper

Metadata Scraper ⭐ 86

🏷️ A JavaScript library for scraping/parsing metadata from a web page.

Instagramy ⭐ 86

Python Package for Instagram Users, Posts, and Hashtag data.

Twitterscraper ⭐ 86

Scrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!

Highanonproxypool ⭐ 84

A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.

Search Google ⭐ 84

Scrape google search results

News Aggregator ⭐ 84

Django project to scrape a news website using Beautiful soup and display in our template.

Twitter Word Cloud ⭐ 84

Twitter word cloud generator

Mongodb Query Exporter ⭐ 83

Prometheus MongoDB aggregation query exporter

Reddit Wallpaper Changer ⭐ 83

Reddit Wallpaper Changer

Trending Youtube Scraper ⭐ 83

Python script that scrapes the currently trending YouTube videos in a variety of countries

A simple (and unofficial) GitHub Trending client that lives in your menubar.

Musiclyrics ⭐ 83

https://www.kaylinpavlik.com/50-years-of-pop-music

Linkedin Jobs Scraper ⭐ 82

Scrape LinkedIn job postings using Selenium WebDriver with python bindings

Dashboard Metrics Scraper ⭐ 80

Container to scrape, store, and retrieve a window of time from the Metrics Server.

Tableau Scraping ⭐ 79

Tableau scraper python library. R and Python scripts to scrape data from Tableau viz

Ca Property Tax ⭐ 78

CA property tax visualization

Web Scraping ⭐ 76

Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!

Prometheus Swarm Discovery ⭐ 76

This is a POC for Prometheus service discovery on Docker Swarm

Goodwe Sems Home Assistant ⭐ 76

Sensor for Home Assistant pulling data from the GoodWe SEMS API for solar panel production metrics.

Cs109 Dl Videos ⭐ 74

Shell script to scrape Harvard CS109 (Intro to Data Science) lecture videos

Rust Wildbow Scraper ⭐ 74

Automatically scrapes wildbow's web serials and compiles them into ebooks

Yahoo Earnings Calendar ⭐ 73

Scrapes Yahoo! Finance earnings calendar to get data for a specific date or a date range.

Meteor Scrape ⭐ 73

Scrape any Website or RSS/Atom-Feed with ease.

Craigslist_scraper ⭐ 73

A gem to scrape and analyze craigslist data

Related Searches

Python Scrape (2,235)

Scraper Scrape (2,054)

Javascript Scrape (913)

101-200 of 1,397 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.