Awesome Open Source

Programming Languages

Search results for data scraping

data-scraping x

54 search results found

Fansly Downloader ⭐ 1,223

Easy to use fansly.com content downloading tool. Written in python, but ships as a standalone Executable App for Windows too. Enjoy your Fansly content offline anytime, anywhere in the highest possible content resolution! Fully customizable to download in bulk or single: photos, videos & audio from timeline, messages, collection & specific posts 👍

This repository helps you understand python from the scratch.

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

C# console app to download all of the media from Onlyfans accounts with DRM video downloading support

Web Scraping ⭐ 276

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Stockeye ⭐ 145

Keep track of short term stock movement by monitoring breaking news activity

Raspagem De Dados Para Iniciantes ⭐ 115

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

Parlance ⭐ 67

A minimum-dependency ECMAScript client library and CLI tool for Parler – a "free speech" social network that accepts real money to buy "influence" points to boost organic non-advertising content

Vinted Scraper ⭐ 63

This is a tool to scrape/download images and data from Vinted & Depop using the API and stores the data in a SQLite database.

Funko Pop Data ⭐ 42

Open-source database of all Funko Pop data.

Rusquant ⭐ 39

Official version of rusquant package for R

Onlysnap ⭐ 31

Scrape content from OnlyFans #onlyfans -- #of-scr -- #onlyfans scrape -- #onlyfans-dl -- OnlyFans content downloader -- #of scrap -- #onlysnap

Google Search Results Java ⭐ 30

Google Search Results JAVA API via SerpApi

Cbse_schools_data ⭐ 27

Cleaned, scraped data of all 20,367 CBSE schools, primarily in India, in 2018. Data scraped from: cbseaff.nic.in/cbse_aff/schdir_Report/userview.asp

Analysing Glassdoor Jobs ⭐ 26

Data Analysis of Job Postings on Glassdoor.

Bilkent Scheduler ⭐ 25

Bilkent Scheduler is an open-source tool designed to assist students at Bilkent University in planning their course schedules.

Scraping Youtube Comments ⭐ 22

Scrape comments from any Youtube video

Torchestrator ⭐ 18

Spin up Tor containers and proxy HTTP requests via these tor instances.

Exile Profit ⭐ 17

This script engages with APIs to collect data and conduct fundamental computations for identifying the optimal approach to generate profits within the game. It also comes with a preconfigured and continuously updating Google Sheet for seamless utilization.

Raspagem De Dados Fatec ⭐ 17

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

Ecommerce Scraping Api ⭐ 16

eCommerce Scraping API code examples for Python, PHP and Node.js

Web Scraping Api ⭐ 15

Web Scraping API code examples for Python, PHP and Node.js

Serp Scraping Api ⭐ 13

SERP Scraping API code examples for Python, PHP and Node.js

Statball ⭐ 13

Statball - Football soccer stats analyser from top 5 european leagues with data obtained by web scraping from Fbref and Statsbomb

Hk Atm Locator ⭐ 10

🏧 香港自動櫃員機定位器 🏧 Centralising Automated Teller Machine (ATM) Data in Hong Kong in a well-defined yet standardised format and display in a web portal for public use

Psx Data Reader ⭐ 10

A scraper for downloading Pakistan stock exchange's data into Python Pandas DataFrame.

Tips, Cheat Sheets, Resources for Data Visualization

Customizable Web Crawler ⭐ 8

This web crawler can be customized to scrape almost all types of websites.

Complete Python Developer Manual ⭐ 8

Class notes for Andrei Neagoie's Complete Python Developer course through Zero to Mastery.

🦙 阿草，数据爬取工具人 / acao, the tool man for data scraping of https://asoul.video/.

Qt Desktop Application For Music Collection ⭐ 8

Data Scraping Project using QT

Econforecasting R ⭐ 8

This is the data scraping & modeling code used for models shown in https://econforecasting.com.

Blox Fruits Auto Farm ⭐ 7

Blox Fruits Auto Farm

Ntuoss Datascraping And Datacleaning Workshop ⭐ 7

This repository contains the reference scripts and the content presented in the NTU OSS Data scraping and Data cleaning workshop.

Datascrapingcrawling ⭐ 7

Data Scraping 정리 자료

Laravel Soccer Compare ⭐ 7

Soccer player management PWA

Datareaper ⭐ 7

DataReaper is a powerful Python tool designed to harvest data from publicly accessible HTTP servers. It combines the capabilities of Shodan search with web scraping techniques to efficiently gather information from targeted websites.

Replit Scraper ⭐ 7

A simple data scraper for Replit

Google Maps Scrapper ⭐ 7

This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.

Nba Topshot Scraper ⭐ 7

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. Data is scraped once per day.

Ytcc Archive ⭐ 7

archiving community contributions on YouTube: unpublished captions, title and description translations and caption credits

Locanesia ⭐ 6

Laravel Package to populate and searching indonesia locations. From Provinces To Villages. Data Scraped from http://www.nomor.net/

C# console app to download DRM protected videos from Onlyfans accounts

Matterport Downloader ⭐ 6

Download Skybox panoramic photos of Matterport houses

This repo is for web data scraping. Feel free to show your ❤️ by giving a star ⭐

News_scraping ⭐ 5

Python Dataupdate Dataprocessor Kbn ⭐ 5

The python module can be used to scrape data and process data from different sources. The python module can output data as either as a dataframe in the country year format or it will output data in excel files This module has primarily been created for processing data for the International Futures (IFs) Project however, it can be used to process data in general. The module can be used to process data from the following sources, 1) World Bank World Development Indicators (WDI) 2) UNESCO Education

Sportscardtoollib ⭐ 5

A python library for grabbing and tracking checklists for sports cards.

Green Finance and Environmental Risk

Work in progress

R Tutorials ⭐ 5

Python Data Scraping Imdb Movie Site Using Beautifulsoup Series 1 ⭐ 5

Data Scraping using Python BeautifulSoup

Facebook Data Extraction ⭐ 5

#DataPipeLine #ETL - Created is a Facebook data extraction utility to extract the publicly available data on Facebook. Used Facebook Graph API and Python to extract the data and loaded the data into the CSV files for further analysis.

1-54 of 54 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.