Awesome Open Source

Programming Languages

Search results for python scraper

1,373 search results found

Advanced Web Scraping Tutorial ⭐ 370

The Zipru scraper developed in the Advanced Web Scraping Tutorial.

Telegramscraper ⭐ 361

Using this tool you can easily add so many members from any group to your group. Less than 2 minutes. Super easy. Time saver. But this tool is only for educational purpose. You could be banned from Telegram. So be careful. Recommanded to use this tool only on Termux.

Moodle Dl ⭐ 355

Moodle-DL downloads course content fast from Moodle (eg. lecture pdfs)

Scrape Linkedin Selenium ⭐ 353

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Linkedindumper ⭐ 337

Python 3 script to dump/scrape/extract company employees from LinkedIn API

Hrequests ⭐ 327

🚀 Web scraping for humans

City Scrapers ⭐ 315

Scrape, standardize and share public meetings from local government websites

Mov Cli ⭐ 314

A cli tool to browse and watch Movies/Shows/TV/Sports.

Freshonions Torscraper ⭐ 313

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Google Image Scraper ⭐ 309

A library to scrap google images

Advanced python library to scrap Twitter (tweets, users) from unofficial API

Memorious ⭐ 302

Lightweight web scraping toolkit for documents and structured data.

Python web scraping framework

Docsearch Scraper ⭐ 289

DocSearch - Scraper

Web Scraping ⭐ 281

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

Onlyfans Scraper ⭐ 277

A tool that allows you to print to file all content you are subscribed to on onlyfans including content you have unlocked or has been sent to you in messages.

Web Scraping ⭐ 276

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Youtube Projects ⭐ 272

This repository contains all the code I use in my YouTube tutorials.

Post Tuto Deployment ⭐ 269

Build and deploy a machine learning app from scratch 🚀

Googlemaps Scraper ⭐ 268

Google Maps reviews scraping

Osint Scraper ⭐ 266

Heroku_ebooks ⭐ 266

An archive of a script to generate Markov chains and to post to an _ebooks account on Twitter using Heroku. No longer actively supported.

一个灵活、友好的爬虫框架

Python Automation Scripts ⭐ 264

Simple yet powerful automation stuffs.

Finance Dl ⭐ 263

Tools for automatically downloading/scraping personal financial data.

Proxy Scraper ⭐ 260

scrape proxies from more than 5 different sources and check which ones are still alive

Weibo_terminator_workflow ⭐ 259

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

Tesla Apiscraper ⭐ 259

API Scraper for pulling Vehicle Statistics from the Tesla Owner API into an InfluxDB + Grafana Dashboards

Covid19_mobility ⭐ 257

COVID-19 Mobility Data Aggregator. Scraper of Google, Apple, Waze and TomTom COVID-19 Mobility Reports🚶🚘🚉

Dark Fantasy Hack Tool ⭐ 248

DDOS Tool: To take down small websites with HTTP FLOOD. Port scanner: To know the open ports of a site. FTP Password Cracker: To hack file system of websites.. Banner Grabber: To get the service or software running on a port. (After knowing the software running google for its vulnerabilities.) Web Spider: For gathering web application hacking information. Email scraper: To get all emails related to a webpage IMDB Rating: Easy way to access the movie database. Both .exe(compressed as zip) and .py

Py Linkedin Jobs Scraper ⭐ 247

Pythonscraping ⭐ 240

The code of book: Python Scraping

Docs Scraper ⭐ 238

Scrape documentation into Meilisearch

Summarizer ⭐ 236

A Reddit bot that summarizes news articles written in Spanish or English. It uses a custom built algorithm to rank words and sentences.

Spatula ⭐ 233

A modern Python library for writing maintainable web scrapers.

Lightnovel_epub ⭐ 233

🍭 epub generator for (light)novels (轻)小说 epub 生成器，支持站点：轻之国度、轻小说文库

Socialreaper ⭐ 233

Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

Scraxbrl ⭐ 232

SEC Edgar Scraper and XBRL Parser/Renderer

Nudecrawler ⭐ 231

Crawl telegra.ph searching for nudes!

Tiktok Hashtag Analysis ⭐ 229

Provides tools to analyze hashtags within posts scraped from TikTok.

Basketball_reference_scraper ⭐ 228

A python module for scraping static and dynamic content from Basketball Reference.

Torrent Api Py ⭐ 228

An Unofficial API for 1337x, Piratebay, Nyaasi, Torlock, Torrent Galaxy, Zooqle, Kickass, Bitsearch, MagnetDL,Libgen, YTS, Limetorrent, TorrentFunk, Glodls, TorrentProject and YourBittorrent

Amazon_scraper ⭐ 227

Provides content not accessible through the standard Amazon API

Fb_friend_list_scraper ⭐ 226

OSINT tool to scrape names and usernames from large friend lists on Facebook, without being rate limited.

Proxyscrape ⭐ 224

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

Dorks Eye ⭐ 224

Dorks Eye Google Hacking Dork Scraping and Searching Script. Dorks Eye is a script I made in python 3. With this tool, you can easily find Google Dorks. Dork Eye collects potentially vulnerable web pages and applications on the Internet or other awesome info that is picked up by Google's search bots. Author: Jolanda de Koff

Social Media Data Scripts ⭐ 222

Twitterinternalapidocument ⭐ 221

Twitter Internal API Document

Webscraping_python_selenium ⭐ 220

Web Scraping Javascript generated pages using Python and Selenium

Amazon Scraper ⭐ 219

A simple web scraper to extract Product Data and Pricing from Amazon

Wayback Machine Scraper ⭐ 219

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Comic Vine Scraper ⭐ 216

An add-on script for ComicRack that lets you copy details from Comic Vine into your comic books.

Scan For Webcams ⭐ 214

scan for webcams on the internet

StackExchange websites to ZIM scraper

Make a ZIM file from any Web site and surf offline!

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

Transistor ⭐ 209

Transistor, a Python web scraping framework for intelligent use cases.

Telegramscraper ⭐ 207

Scraper and adder for Telegram supporting multiple accounts at the same time. Adds via Telegram API and only by username. For adding via ID and not needing Telgram API contact me.

Bbb Face Recognizer ⭐ 202

Face recognition system using MTCNN, FACENET, SVM and FAST API to track participants of Big Brother Brasil in real time.

Souqscraper ⭐ 201

Simple scripts for Level UP your scraping Skills, and source code for Level UP playlist on Youtube

The Slash OSINT Tool

Mangadex Dl ⭐ 199

Download manga from MangaDex.org

Ha Multiscrape ⭐ 198

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Etherscan Labels ⭐ 196

Full label data dump of top EVM chains in JSON/CSV.

Anime Dl ⭐ 196

Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.

Readablewebproxy ⭐ 195

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

Scrapelib ⭐ 195

⛏ a library for scraping unreliable pages

Scrapetube ⭐ 192

A YouTube scraper for scraping channels, playlists, and searching 🔎

Anipy Cli ⭐ 191

Little tool in python to watch and download anime from the terminal (the better way to watch anime). Also applicable as an API

Letterboxd_recommendations ⭐ 190

Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username

Scrapyz ⭐ 188

"Scrape Easy" - an extension of the Scrapy framework.

Flickr_scraper ⭐ 188

Simple Flickr Image Scraper

Daath Ai Parser ⭐ 184

Daath AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.

Instagram Follower Scraper ⭐ 181

Scrapes all the data of followers of any instagram account

Telegram Scraper Adder ⭐ 178

Python Script For Scarpe Telegram Members From Another Group And Add That Members To Your Group.

Nyt First Said ⭐ 177

Tweets when words are published for the first time in the NYT

Munich Scripts ⭐ 177

Some useful scripts simplifying bureaucracy

Free Proxy ⭐ 176

Free proxy scraper written in python. It is pypi library - free to use.

Cookedgrabber ⭐ 176

Discord, Twitter, Instagram, Netflix cookies, token grabber and also password grabber. Grabbing from all web browsers !

Trump Lies ⭐ 175

Tutorial: Web scraping in Python with Beautiful Soup

Scrappy ⭐ 173

ScrapPY is a Python utility for scraping manuals, documents, and other sensitive PDFs to generate wordlists that can be utilized by offensive security tools to perform brute force, forced browsing, and dictionary attacks against targets. The tool dives deep to discover keywords and phrases leading to potential passwords or hidden directories.

Python Web Scraping Tutorial ⭐ 169

A Python-based web and data scraping tutorial

Crawley ⭐ 167

Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.

Whatscraper ⭐ 167

A Whatsapp Group Link Scraper And Checker

Continuous reconnaissance scanner. Find and analyze internet-connected devices in minutes.

Findpapers ⭐ 164

Findpapers: A tool for helping researchers who are looking for related works

Metadetective ⭐ 164

🕵️ Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

Atp World Tour Tennis Data ⭐ 162

Using Python to scrape ATP World Tour tennis data

Thescrapper ⭐ 161

Scrape emails, phone numbers and social media accounts from a website.

Auto Gmail Creator ⭐ 158

Open Source Bulk Auto Gmail Creator Bot with Selenium & Seleniumwire ( Python ). Feel free to contact me with Django/Flask, ML, AI, GPT, Automation, Scraping.

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a Tweets and more while evading most API limitations.

Arxivscraper ⭐ 156

A python module to scrape arxiv.org for specific date range and categories

Place 2022 ⭐ 155

Analysing and storing raw data from r/Place 2022 event

Spotifile ⭐ 155

Spotify scraper

Airbnb Scraper ⭐ 153

Airbnb Scraper: Advanced Airbnb Search using Scrapy

Learn Python ⭐ 152

Python Top 45 Articles of 2017

Scrapers ⭐ 152

Code relating to scraping public police data.

Facebook_page_scraper ⭐ 150

Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV

Media Scraper ⭐ 150

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

Tiktokpy ⭐ 148

Extract data from TikTok without needing any login information or API keys.

Related Searches

Python Django (26,307)

Python Machine Learning (20,195)

Python Dataset (14,792)

Python Flask (14,408)

Python Docker (13,757)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,646)

Python Algorithms (10,033)

101-200 of 1,373 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.