Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Data Scraping Open Source Projects

Open source projects categorized as Data Scraping
Categories > Data Scraping
Fansly Downloader ⭐ 1,103
Easy to use fansly.com content downloading tool. Written in python, but ships as a standalone Executable App for Windows too. Enjoy your Fansly content offline anytime, anywhere in the highest possible content resolution! Fully customizable to download in bulk or single: photos, videos & audio from timeline, messages, collection & specific posts 👍
most recent commit 3 months ago
Python ⭐ 951
This repository helps you understand python from the scratch.
most recent commit 3 months ago
Xidel ⭐ 611
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
most recent commit 5 months ago
Reaper ⭐ 355
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
most recent commit 5 years ago
Of Dl ⭐ 283
C# console app to download all of the media from Onlyfans accounts with DRM video downloading support
most recent commit 3 months ago
Web Scraping ⭐ 276
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
most recent commit 2 years ago
Stockeye ⭐ 145
Keep track of short term stock movement by monitoring breaking news activity
most recent commit 7 years ago
Raspagem De Dados Para Iniciantes ⭐ 115
Raspagem de dados para iniciante usando Scrapy e outras libs básicas
most recent commit a year ago
Parlance ⭐ 67
A minimum-dependency ECMAScript client library and CLI tool for Parler – a "free speech" social network that accepts real money to buy "influence" points to boost organic non-advertising content
dependent packages 2total releases 12most recent commit 2 years agonpm @castlelemongrab/parlance} Downloads
Vinted Scraper ⭐ 63
This is a tool to scrape/download images and data from Vinted & Depop using the API and stores the data in a SQLite database.
most recent commit 4 months ago
Funko Pop Data ⭐ 42
Open-source database of all Funko Pop data.
most recent commit a year ago
Rusquant ⭐ 39
Official version of rusquant package for R
most recent commit 4 months ago
Onlysnap ⭐ 31
Scrape content from OnlyFans #onlyfans -- #of-scr -- #onlyfans scrape -- #onlyfans-dl -- OnlyFans content downloader -- #of scrap -- #onlysnap
most recent commit 7 months ago
Google Search Results Java ⭐ 30
Google Search Results JAVA API via SerpApi
most recent commit 4 months ago
Cbse_schools_data ⭐ 27
Cleaned, scraped data of all 20,367 CBSE schools, primarily in India, in 2018. Data scraped from: cbseaff.nic.in/cbse_aff/schdir_Report/userview.asp
most recent commit 6 years ago
Analysing Glassdoor Jobs ⭐ 26
Data Analysis of Job Postings on Glassdoor.
most recent commit 2 years ago
Bilkent Scheduler ⭐ 25
Bilkent Scheduler is an open-source tool designed to assist students at Bilkent University in planning their course schedules.
most recent commit 3 months ago
Scraping Youtube Comments ⭐ 22
Scrape comments from any Youtube video
most recent commit 3 years ago
Torchestrator ⭐ 18
Spin up Tor containers and proxy HTTP requests via these tor instances.
most recent commit 3 years ago
Exile Profit ⭐ 17
This script engages with APIs to collect data and conduct fundamental computations for identifying the optimal approach to generate profits within the game. It also comes with a preconfigured and continuously updating Google Sheet for seamless utilization.
most recent commit 3 months ago
Raspagem De Dados Fatec ⭐ 17
📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí
most recent commit 5 years ago
Ecommerce Scraping Api ⭐ 16
eCommerce Scraping API code examples for Python, PHP and Node.js
most recent commit 7 months ago
Web Scraping Api ⭐ 15
Web Scraping API code examples for Python, PHP and Node.js
most recent commit 7 months ago
The 4 Latest Releases In Data Scraping Open Source Projects
Replit Scraper ⭐ 7
A simple data scraper for Replit
total releases 1latest release March 20, 2023most recent commit a year ago
Psx Data Reader ⭐ 10
A scraper for downloading Pakistan stock exchange's data into Python Pandas DataFrame.
total releases 5latest release April 16, 2022most recent commit a year ago
Gfer ⭐ 5
Green Finance and Environmental Risk
total releases 8latest release February 06, 2022most recent commit 2 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.