Awesome Open Source

Programming Languages

Search results for python scrape

636 search results found

Notion On Firebase ⭐ 66

serve notion.so pages on firebase hosting, enabling search engine indexing and custom routes

Trendy Scraper ⭐ 65

Scrapes Google Trends data over long timescales and stitches together for daily data

Quora Crawler ⭐ 64

Python crawler for quora.com

Pysoundcloud ⭐ 64

Scraping the Un–scrapable™

Scrapes sites. Gets news. Eventually events.

Odds Portal Scraper ⭐ 62

Sports odds and results scraping for Odds Portal (oddsportal.com).

OKCupid profile datasets, code to scrape okcupid, and code to compute reading level of text

Kenpompy ⭐ 61

A simple yet comprehensive web scraper for kenpom.com.

Scrape_news ⭐ 60

using python Scrapy framework, do multiprocess scrape news

Google Emailscraper ⭐ 60

Scraper that searches Google based on a query and scrapes all emails found on each page.

Wiki Table Scrape ⭐ 59

Scrape tables from Wikipedia articles into CSVs

Web Scraping Reddit ⭐ 59

Web scraping Reddit without using Reddit API, and making a dataset, and using the dataset for a machine learning project.

Spam Bot 3000 ⭐ 59

Social media research and promotion, semi-autonomous CLI bot

Scraping Tripadvisor With Python 2020 ⭐ 58

Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website

Hypescript ⭐ 58

Python HypeMachine script downloader

Openkamer ⭐ 57

Insight into the Dutch parliament (openkamer.org)

MetroLyrics API for Python

Coinmarketcap Historical Prices ⭐ 55

Makes use of python3 and bs4 to scrape historical cryptocurrency prices, volume and market caps from coinmarketcap.com

Romcollectionbrowser ⭐ 54

Kodi - Rom Collection Browser

Scraper Boilerplate ⭐ 54

Nba_scraper ⭐ 53

A scraper to scrape the NBA API and compile a play by play file

Mass Scraping ⭐ 53

Quickly download and scrape websites on a massive scale.

Scrape Itebooks ⭐ 52

Site does not have downloads anymore, repo is not kept up to date atm.

Mailman Archive Scraper ⭐ 51

Python script that scrapes public and private Mailman archive pages and republishes them to local files, and generates an RSS feed of recent emails.

Flickr Scrape ⭐ 51

Dashboard ⭐ 50

A tkinter GUI collating various data

Vk Scraper ⭐ 49

Scrape VK media

Ransomware.live ⭐ 49

🏴‍☠️💰 Another Ransomware gang tracker

Linkedin_profiles ⭐ 49

scrapes Linkedin for company employee profiles

Whereis Whoishiring Hiring ⭐ 49

Code running http://whereis-whoishiring-hiring.me

Facebook Multi Scraper ⭐ 48

Multi-threaded Facebook scraper for social analytics of public and owned pages

An OSINT employee/username enumeration tool

Ginlong Scraper ⭐ 48

A python script that scrapes PV statistics from the Ginlong monitor pages and outputs it to influxdb, pvoutput or mqtt

Bookingscraper ⭐ 47

🌎 🏨 Scrape Booking.com 🏨 🌎

Recipe Box ⭐ 47

Scrape lists of recipes

Data_jobs_data ⭐ 46

Fzbypassbot ⭐ 46

A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!

Scrape Finance Data V2 ⭐ 45

A standalone package to scrape financial data from listed Vietnamese companies via Vietstock

Google_patent_scraper ⭐ 45

A python module to scrape patents from 'https://patents.google.com/'.

Yelpcrawl ⭐ 45

Crawl and scrape Yelp's restaurant data for every zip code in the United States (or a specified zipcode). Yelp Crawler.

Beautifulsoup Tutorial ⭐ 45

✨ 🍜 Scrape webpage metadata using BeautifulSoup.

Scrape Schema Recipe ⭐ 44

Scrapes recipes from HTML https://schema.org/Recipe (Microdata/JSON-LD) into Python dictionaries.

Reddit Image Scraper 1.0 ⭐ 44

Scrapes/downloads a selected subreddit's posted images by a specified date range on http://reddit.com

Usedvehiclesearch ⭐ 42

Filter vehicles from Craigslist

A scraper written in python to scrape the public pastebin archive and filter with customizable and extensible YARA rules

Image Downloader ⭐ 41

Bet365 Scraper ⭐ 41

Python script to scrape Bet365 odds using Selenium.

Stash_theporndb_scraper ⭐ 41

A python script to scrape Stash data from thePornDB

Weboutlook ⭐ 41

Python library that screen-scrapes MS Outlook Web access

Scraping Google Images Using Python ⭐ 38

Now scrape as many images as you want, from google images using Python, Chromdriver and Selenium

Searchenginescrapy ⭐ 38

Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com

DEPRECATED - Scrape caching server logs and send periodic reports

Get Tweet Replies With Python Tweepy ⭐ 37

Extract Replies to a Specific Tweet using Python and Tweepy - Scrape Any Tweet Reply

Scrape Youtube Channel Videos Url ⭐ 37

This Python script is used to scrape all the video links from a youtube channel.

Python Legistar Scraper ⭐ 37

Scrapes municipal data from Legistar websites

Github Scraper ⭐ 36

A scraper focused on organizational Github accounts and their members.

Linkedin Comments Scraper ⭐ 36

Script to scrape comments (including name, profile link, pfp, designation, email(if present), and comment) from a LinkedIn post from the URL of the post.

Discord Scraper ⭐ 36

Scrapes messages from channel or DM and saves it to txt file

Django Kickstarter Scraper ⭐ 36

Scrapes kickstarter and stores to a mySQL database using django.

Kijiji Scraper ⭐ 36

Python script to scrape Kijiji and find new ads.

Takestock ⭐ 35

This project scrapes multiple sites for stock data. It can get values for Earnings Dates, Stock Prices, PE & PEG Ratios, RSIs, and 52 Week Hi and Lows.

Sbrscraper ⭐ 35

Script to scrape SBR's betting-odds site

Sportsbook ⭐ 35

A sports data scraping and analysis tool

Hadoop_exporter ⭐ 35

A hadoop exporter for prometheus, scrape hadoop metrics (including HDFS, YARN, MAPREDUCE, HBASE. etc.) from hadoop components jmx url.

Newsscraper ⭐ 34

Scraping Assisted by Learning

Scrapy Flask ⭐ 34

Execute Scrapy spiders in a Flask web application

Scrapers ⭐ 34

scrapers for building your own image databases

Company Reviews ⭐ 33

Scrape Indeed for job listings and Indeed & Glassdoor for company reviews. Topic model the reviews.

30 Days Of Python ⭐ 33

Scrapy Cloudflare Middleware ⭐ 32

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

Google Play Store Review Extractor ⭐ 32

☎️ Extract/Scrape Google Play Store Reviews of any Android Application ☎️

Iptv Link Scraper ⭐ 32

IPTV-Link-Scraper scrapes IPTV links from https://streamtest.in/ and save them as m3u file.

Google Maps Businesses Scraper ⭐ 31

Built with Python running Selenium, this app allows you to scrape places info from the google maps search results

Hma Scraper ⭐ 31

Scrapes the obfuscated proxy list at proxylist.hidemyass.com

Bitcointalk Scraper ⭐ 31

Python-based scraper / crawler for members and messages on bitcointalk.org

Grey_harvest ⭐ 31

Scrapes the web for reliable http or https proxies and prints them to stdout. Can also be used as a python library to easily generate reliable proxies for use within Python applications.

Supercharged Web Scraping With Asyncio ⭐ 31

Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).

Goodreadsscraper ⭐ 30

📚 A GoodReads.com Scraper script to get books reviews including text and rating.

It Ebooks Dl ⭐ 30

Depreciated, use project scrape-itebooks

Pentest Chainsaw ⭐ 30

Scrapes Router Passwords From http://www.routerpasswords.com ,more then +300 product

Disney Fastpass Bot ⭐ 30

This project automates the process of finding and confirming Disney World FastPasses. Using python, I can scrape data from the Disney World site, read the results, and decide whether or not to confirm that FastPass

Configurable Python Web Scraper

Pleco Stock Scraper ⭐ 29

Scrape stock data for canadian companies and store in a database.

Linkedin_scraper ⭐ 29

🙋 A Selenium based automated program that scrapes profiles data,stores in CSV,follows them and saves their profile in PDF.

Non Api Fb Scraper ⭐ 29

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

Bloomberg_stock_data ⭐ 29

Scrape Bloomberg for stock data

Itunes App Scraper ⭐ 29

A simple Python scraper for the iTunes App Store

Amazon Scraper ⭐ 29

Amazon Price scraping tool

Espn Basketball ⭐ 29

An outdated ESPN Play-By-Play scraper... Not worth your time. Make your own!

110k Dutch Book Reviews Dataset for Sentiment Analysis

Pycon Speakers ⭐ 29

Speakers Spider (PyCon 2014 sprint)

Offliberate ⭐ 28

Scrape media right from your terminal with the help of Offliberty.

Magnetmagnet ⭐ 28

MagnetMagnet is a scraper that allows you to scrape torrent information, such as: magnet links, name, size, seeders and leachers, from Kick Ass Torrents, Nyaa, RARBG, The Pirate Bay and 1377x in any category and sub category

Scrape_google ⭐ 28

Starter Script To Scrape Google

Python Scrapilicious ⭐ 28

Unmaintained: A horridly implemented scrapy app that will scrape all (?) of Delicious' bookmarks.

Amazon Review Scraper ⭐ 27

A python library to scrape data from amazon.com

Chineseair ⭐ 27

Graphing air quality readings from several major Chinese centers

Python module to rename media collections based on scrapes from thetvdb.com. CLI and GUI tools, too!

Hipposcraper ⭐ 26

A Linux terminal tool for parsing and scraping Holberton project pages to automate repetitive tasks.

Related Searches

Python Django (28,897)

Python Machine Learning (20,195)

Python Flask (17,643)

Python Dataset (14,792)

Python Docker (13,757)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

Python Algorithms (10,033)

101-200 of 636 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.