Awesome Open Source

Programming Languages

Search results for scrape

1,397 search results found

Scrapeer ⭐ 72

Essential PHP library that scrapes HTTP(S) and UDP trackers for torrent information.

Emojitaco ⭐ 72

Alfred Emoji Script with Taco and other unicode 9 emoji

Laravel Intelligent Scraper ⭐ 72

Service to scrape a web page easily without knowing their HTML structure.

Iterscraper ⭐ 72

Scrape URLs that contain an incrementing integer ID in the path

Pbpstats ⭐ 72

A package to scrape and parse NBA, WNBA and G-League play-by-play data.

Tool to scrape LinkedIn

Blinkist Scraper ⭐ 71

📚 Python tool to download book summaries and audio from Blinkist.com, and generate some pretty output

Scrapy Wayback Machine ⭐ 70

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Google Search SERP Scraper

Bhadoo Index Scraper ⭐ 69

script to scrape direct download links (ddls) from google drive index.

Linkedin Scraper ⭐ 69

Tool to scrape linkedin

Tripadvisor Scraper ⭐ 68

TripAdvisor scraper

Prometheus Rsocket Proxy ⭐ 68

An RSocket proxy to pull metrics from applications that can only open egress

Opentracker ⭐ 67

一个linux中开源和免费的BitTorrent Tracker

Fine Ants ⭐ 67

A gem that fetches bank accounts using Capybara

Notion On Firebase ⭐ 66

serve notion.so pages on firebase hosting, enabling search engine indexing and custom routes

Distributed Scraper

Trendy Scraper ⭐ 65

Scrapes Google Trends data over long timescales and stitches together for daily data

browsing urls with cookies, that is, we can scrape with authenticated pages! (Node.js)

Scrapes sites. Gets news. Eventually events.

Quora Crawler ⭐ 64

Python crawler for quora.com

Pysoundcloud ⭐ 64

Scraping the Un–scrapable™

Amazon_scraper ⭐ 64

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Php Torrent Scraper ⭐ 63

Scrape torrents stats with PHP using HTTP or UDP

OKCupid profile datasets, code to scrape okcupid, and code to compute reading level of text

Odds Portal Scraper ⭐ 62

Sports odds and results scraping for Odds Portal (oddsportal.com).

Kenpompy ⭐ 61

A simple yet comprehensive web scraper for kenpom.com.

Stack Scraper ⭐ 61

Scraping Service ⭐ 61

REST API for scraping dynamic websites using Node.js, headless Chrome and Cheerio.

Scrape_news ⭐ 60

using python Scrapy framework, do multiprocess scrape news

Google Emailscraper ⭐ 60

Scraper that searches Google based on a query and scrapes all emails found on each page.

Insta_scrape ⭐ 59

The instagram swiss army knife. Restores all deprecated hashtag functionality and grants public api access from instagram's front end without any of the authorization.

Web Scraping Reddit ⭐ 59

Web scraping Reddit without using Reddit API, and making a dataset, and using the dataset for a machine learning project.

Itunesfeaturedcheck ⭐ 59

Scrapes the App Store and finds out whether an app is featured on either the App Store homepage or in a specific category

Home_price_estimator ⭐ 59

Uses Zillow metadata, NLP on realtor description, and VGG16 on home images to predict home sale prices in Portland from 6/16 - 7/17.

A web scraping framework for .NET

Price Finder ⭐ 59

Finds the prices of retail items online

Wiki Table Scrape ⭐ 59

Scrape tables from Wikipedia articles into CSVs

Spam Bot 3000 ⭐ 59

Social media research and promotion, semi-autonomous CLI bot

Scraping Tripadvisor With Python 2020 ⭐ 58

Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website

Hypescript ⭐ 58

Python HypeMachine script downloader

Goscraper ⭐ 58

Golang pkg to quickly return a preview of a webpage (title/description/images)

Harbor_exporter ⭐ 57

prometheus exporter for harbor v1

Social Builder ⭐ 57

Openkamer ⭐ 57

Insight into the Dutch parliament (openkamer.org)

Spotify Playlist Generator

MetroLyrics API for Python

Html Table To Json ⭐ 56

Easily scrape and parse a table stored on a web page.

Extensible paste site scraper written in Golang.

Coinmarketcap Historical Prices ⭐ 55

Makes use of python3 and bs4 to scrape historical cryptocurrency prices, volume and market caps from coinmarketcap.com

Romcollectionbrowser ⭐ 54

Kodi - Rom Collection Browser

Scraper Boilerplate ⭐ 54

Gh Readme Scrape ⭐ 54

a CLI to bulk download URLs (images/pdfs/etc) from GitHub readmes

Nba_scraper ⭐ 53

A scraper to scrape the NBA API and compile a play by play file

Diffbot Php Client ⭐ 53

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Mass Scraping ⭐ 53

Quickly download and scrape websites on a massive scale.

Cloudwatch_exporter ⭐ 53

A CloudWatch exporter for Prometheus coded in Go, with multi-region support

Next-generation serverless crawler for COVID-19 data

Ledbetter ⭐ 52

Script that scrapes alert statistics from Nagios and reports them to Graphite

Scrape Itebooks ⭐ 52

Site does not have downloads anymore, repo is not kept up to date atm.

Fb_scraper ⭐ 52

FBLYZE is a Facebook scraping system and analysis system.

Opensource ⭐ 51

🔦 Discover the open source ecosystem related to the Dominican Republic!

Scrape Dns ⭐ 51

Searches for interesting cached DNS entries.

Mailman Archive Scraper ⭐ 51

Python script that scrapes public and private Mailman archive pages and republishes them to local files, and generates an RSS feed of recent emails.

🎼 Expandable lyrics-scraping API for Java

Flickr Scrape ⭐ 51

Dashboard ⭐ 50

A tkinter GUI collating various data

Cloudflare Scrape Android ⭐ 49

A tool to bypass the Cloudflare DDOS page

Scrape boards & threads from 4chan. Download images, videos and HTML if desired.

Linkedin_profiles ⭐ 49

scrapes Linkedin for company employee profiles

Alligator ⭐ 49

alligator is aggregator for system and software metrics

Page Compare ⭐ 49

Simple heuristic for measuring web page similarity (& data set)

Whereis Whoishiring Hiring ⭐ 49

Code running http://whereis-whoishiring-hiring.me

Vk Scraper ⭐ 49

Scrape VK media

Ransomware.live ⭐ 49

🏴‍☠️💰 Another Ransomware gang tracker

Facebook Multi Scraper ⭐ 48

Multi-threaded Facebook scraper for social analytics of public and owned pages

Scalawebscraper ⭐ 48

Scala Webscraper

Node Anime Scraper ⭐ 48

Scrapes information from Gogoanime to get Anime, Episode & Video information & urls.

Ginlong Scraper ⭐ 48

A python script that scrapes PV statistics from the Ginlong monitor pages and outputs it to influxdb, pvoutput or mqtt

An OSINT employee/username enumeration tool

V2ray Exporter ⭐ 47

🧭 Prometheus exporter for V2Ray and V2Fly metrics, with a simple Grafana dashboard.

Bookingscraper ⭐ 47

🌎 🏨 Scrape Booking.com 🏨 🌎

Recipe Box ⭐ 47

Scrape lists of recipes

Node Image Scraper ⭐ 47

Node.js module for scraping images from the web.

Data_jobs_data ⭐ 46

Tap News System ⭐ 46

⚡️ React,Express,Flask. Get and recommend news

Fzbypassbot ⭐ 46

A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!

Node.js based scraper using headless chrome

Wohnung Scraper ⭐ 45

A web application which scrapes several German real estate listing websites and visualizes offers in a map.

Kindle Your Highlights ⭐ 45

Scrape highlights from kindle.amazon.com

Scrape Finance Data V2 ⭐ 45

A standalone package to scrape financial data from listed Vietnamese companies via Vietstock

Twitter Screen Scrape ⭐ 45

scrape public twitter data w/out API access

Google_patent_scraper ⭐ 45

A python module to scrape patents from 'https://patents.google.com/'.

Yelpcrawl ⭐ 45

Crawl and scrape Yelp's restaurant data for every zip code in the United States (or a specified zipcode). Yelp Crawler.

Docker_exporter ⭐ 45

Exports metrics about a Docker installation

Beautifulsoup Tutorial ⭐ 45

✨ 🍜 Scrape webpage metadata using BeautifulSoup.

Scrape Schema Recipe ⭐ 44

Scrapes recipes from HTML https://schema.org/Recipe (Microdata/JSON-LD) into Python dictionaries.

Shopee Scrape ⭐ 44

Shopee Scrape is a tool that functions to collect data - the data needed, such as finding data from photos, prices, names, store locations and others.

Reddit Image Scraper 1.0 ⭐ 44

Scrapes/downloads a selected subreddit's posted images by a specified date range on http://reddit.com

Related Searches

Python Scrape (2,235)

Scraper Scrape (2,054)

Javascript Scrape (913)

201-300 of 1,397 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.