Awesome Open Source

Programming Languages

Search results for python scraper

1,373 search results found

Instascrape ⭐ 145

🚀 A fast and lightweight utility and Python library for downloading posts, stories, and highlights from Instagram.

Itauscraper ⭐ 145

Scraper para baixar seus extratos do Itaú com um comando.

Web Database Analytics ⭐ 144

Web scrapping and related analytics using Python tools

Yahoo Ticker Symbol Downloader ⭐ 144

A web scraper for ticker symbols from yahoo finance

Saveddit ⭐ 143

Bulk Downloader for Reddit

Linkedin Scraper ⭐ 143

A playwright bot which is implemented to scrape linkedin and store advertisement data in a database and telegram channel

estela, an elastic web scraping cluster 🕸

Selenium_extensions ⭐ 141

Tools that will make writing tests, bots and scrapers using Selenium much easier

Amazon Scraper ⭐ 140

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

Appstorereviews ⭐ 140

Apple AppStore reviews scraper

News Fetch ⭐ 140

A Python Package which helps to scrape all news details from any news websites

Onegram ⭐ 136

This repository is no longer maintained.

Patch Checker ⭐ 135

Web-based check for Windows privesc vulnerabilities

a command-line web scraping tool

Hockey Scraper ⭐ 134

Python Package for scraping NHL Play-by-Play and Shift data

Email Extractor ⭐ 134

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Google2csv ⭐ 131

Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file

Not Your Average Web Crawler ⭐ 130

A web crawler (for bug hunting) that gathers more than you can imagine.

Zillow Scraper for Python using Selenium

Slideshare Downloader ⭐ 129

Download ⬇️ slides from 🎨 SlideShare in no time⚡️

Scrapers ⭐ 128

Lots and lots of web scrapers

Youtube Watch History Scraper ⭐ 126

Scrapy YouTube watch history spider. Because YouTube didn't have a history search.

Udemycoursegrabber ⭐ 125

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

Serpscrap ⭐ 125

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

Linkedin Learning Downloader ⭐ 125

Linkedin Learning videos downloader

Spyscrap ⭐ 124

CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.

Nintendeals ⭐ 124

Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).

Ao3scraper ⭐ 123

A Python scraper for getting fan fiction content and metadata from Archive of Our Own.

Linkedin_learning_courses_downloader ⭐ 122

LLCD is a simple python scraper tool that downloads video lessons from Linkedin Learning

Shadow Useragent ⭐ 122

Pick the most common user-agents on the Internet 👻

Telegram Channel Member Scraper ⭐ 121

Scraping The Accounts Of Telegram Channel Members To add those to Group or Channel

Xword Dl ⭐ 121

⬛⬜⬛ Command line tool to scrape crosswords from online solvers and save them as .puz files ⬛⬜⬛

Rpscrape ⭐ 120

Scrape horse racing results data and racecards.

Gsoc Organisation Scraper ⭐ 120

Scrape GSoC organisations using a single script.

Languagepod101 Scraper ⭐ 119

Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

Gutenberg ⭐ 118

Scraper for downloading the entire ebooks repository of project Gutenberg

Leetcode Questions Scraper ⭐ 117

Scrape Algorithm Questions from leetcode and generate html and epub file

Linkedinscraping ⭐ 117

Scraping of LinkedIn Profiles: Creates an Excel file containing the personal data and the last job position of all the provided LinkedIn profiles.

Instagram Python Scraper ⭐ 116

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!

Raspagem De Dados Para Iniciantes ⭐ 115

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

Homeharvest ⭐ 114

Python package for real estate scraping of MLS listing data

Od Database ⭐ 113

Distributed crawler, database and web frontend for public directories indexing

dosage is a comic strip downloader and archiver

Jimutmap ⭐ 112

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.

Linkedinscraper ⭐ 112

Scrapes public information off of LinkedIn

Googlesearch ⭐ 112

Python library for scraping google search results

Cf Clearance Scraper ⭐ 111

A simple program for scraping Cloudflare clearance (cf_clearance) cookies from websites issuing Cloudflare challenges to visitors

Bankscraper ⭐ 110

Brazilian Bank and Benefit Scraping Tool

Gflare Tk ⭐ 110

Open-Source Python Based SEO Web Crawler

Giggity ⭐ 110

Wraps github api for openly available information about an organization, user, or repo

Bad Robo ⭐ 110

🐙 Get Daily 400-500 Real Followers 👽 [BadRobo] is Best Instagram Bot Available Now with All Features!. Our BOT did not violate any of Instagram's rules, so you don't have to worry about getting ACTION BLOCK!

Pastepwn ⭐ 109

Python framework to scrape Pastebin pastes and analyze them

comic updater, mangafied

Scraping ⭐ 108

京东，淘宝，苏宁，亚马逊爬虫抓取商品信息并分析数据

Python Web Scraping Cookbook ⭐ 107

Python Web Scraping Cookbook, published by Packt

Machinelearning ⭐ 106

Machine learning for beginner(Data Science enthusiast)

Demiurge ⭐ 106

PyQuery-based scraping micro-framework.

Seleniumcrawler ⭐ 105

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Instagram Scraper ⭐ 105

Some scrapy spiders useful to crawl instagram posts using public APIS (No TOKEN)

Scraper ⭐ 104

Web scraper for scraping, tracking and visualizing prices of products on various websites.

Stock Market Scraper ⭐ 104

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

Proxy List ⭐ 103

A list of scrapped public proxies that is updated every 15 minutes.

Gesetze Tools ⭐ 103

Scripts to maintain German law git repository

Scrapekit ⭐ 101

Python library with common functionality for writing web scrapers

Apify Sdk Python ⭐ 101

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

The Youtube Scraper ⭐ 101

Download YouTube video description and video comments without using the YouTube API.

Itauscraper ⭐ 101

Scraper para obter dados de contas correntes: extratos, cartões e investimentos, do banco de Itaú para pessoa física

Yt Videos List ⭐ 100

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

📖 Collect links to profiles by username through search engines and analyze with various plugins

A super simple multithreaded proxy scraper; scraping & checking ~80k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.

Adultscraperx.bundle ⭐ 98

plex adult scraper

Sentiment Analysis Of Financial News Data ⭐ 98

Sentiment Analysis of news on stock prices

Instagram Comments Scraper ⭐ 98

Instagram comment scraper using python and selenium. Save the comments into excel.

Basketball_reference ⭐ 98

Basketball Reference Scraper

Webtoon Downloader ⭐ 96

Webtoons Scraper able to download all chapters of any series wanted.

Firmware scraper

Vsco Scraper ⭐ 96

Easily allows for scraping a VSCO

Code for the second edition Web Scraping with Python book by Packt Publications

Brutescrape ⭐ 95

A web scraper for generating password files based on plain text found

Arxiv Miner ⭐ 94

arxiv_miner is a toolkit for mining research papers on CS ArXiv.

Inspectors General ⭐ 94

Collecting reports from Inspectors General across the US federal government.

Scrapemark ⭐ 94

Super-convenient web scraping in Python

Python Selenium Action ⭐ 93

Run Selenium with Python via Github Actions using Headless or Non-Headless browsers!

Rymscraper ⭐ 92

Python API to extract data from rateyourmusic.com.

Whatsapp Scraping ⭐ 92

Python script to get WhatsApp iformation frrom WhatsApp Web

python Movie Info Web Crawler

Soccerapi ⭐ 91

soccerapi ⚽️ , an unambitious soccer odds scraper

Knowledge Gpt ⭐ 91

Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.

Facebook Post Scraper ⭐ 89

Facebook Post Scraper 🕵️🖱️

Media Search Engine ⭐ 89

Search geolocations for (social) media posts in databases like Bellingcat, Cen4InfoRes etc.

Scrapers Us Municipal ⭐ 88

Scrapers for US municipal governments.

Glassdoor Review Scraper ⭐ 88

Scrape reviews from Glassdoor

Funda Scraper ⭐ 88

Scraper of the Dutch real estate website www.funda.nl, implemented in Python with Scrapy

An API to easily get data from the University of Pittsburgh

Movies And Series Scraper ⭐ 86

A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.

Instagramy ⭐ 86

Python Package for Instagram Users, Posts, and Hashtag data.

Twitterscraper ⭐ 86

Scrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!

Jabba Webkit ⭐ 86

Jabba's headless webkit browser for scraping AJAX-powered webpages.

Web Poet ⭐ 85

Web scraping Page Objects core library

Transfermarkt Api ⭐ 84

API service to get data from Transfermarkt

Related Searches

Python Django (26,307)

Python Machine Learning (20,195)

Python Dataset (14,792)

Python Flask (14,408)

Python Docker (13,757)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,646)

Python Algorithms (10,033)

201-300 of 1,373 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.