Awesome Open Source

Programming Languages

Search results for scraper sqlite

21 search results found

Youtube Comment Suite ⭐ 220

Download YouTube comments from numerous videos, playlists, and channels for archiving, general search, and showing activity.

Mstables ⭐ 158

MorningStar.com scraper that consolidates tens of thousands of financial records into a SQLite relational database. Class 'dataframes' easily converts the SQLite data into pandas DataFrames (see Jupyter notebook for examples)

Web Database Analytics ⭐ 144

Web scrapping and related analytics using Python tools

Scraper ⭐ 109

AlphaReigns DHT Scraper, includes peer updater and categorizer

Instagram Reels Scraper Auto Poster ⭐ 84

Reels-AutoPilot: Reels-AutoPilot is a powerful GitHub repository that scrapes reels from specified Instagram accounts and automatically posts them to your account. Keep up with the latest content from your favorite creators and effortlessly share it with your followers. Enhance your Instagram presence and grow your account with Reels-AutoPilot!

Kikoeru Express ⭐ 79

kikoeru 后端，不再维护，请到https://github.com/umonaca/kikoeru-expre 获取更新

Pastebin Scraper ⭐ 67

Live-scraping pastebin to fight boredom.

Vinted Scraper ⭐ 63

This is a tool to scrape/download images and data from Vinted & Depop using the API and stores the data in a SQLite database.

Xa Scraper ⭐ 62

Wdg Projects ⭐ 32

A list of /wdg/ personal projects https://wdg.one/

Colly Sqlite3 Storage ⭐ 27

A SQLite3 storage back end for the Colly web crawling/scraping framework https://go-colly.org

User Agent_strings_db ⭐ 26

Python scraper that grabs user agent strings and populates them into sqlite/JSON files

Savantscraper ⭐ 21

Using Python to add Baseball Savant data to a SQLite database

Scrapemeagain ⭐ 21

Yet another Python web scraping application

Disease Info ⭐ 21

Repo for disease info; a health information data scrapper. Raw data from the scrapper's API is displayed in JSON -

Youtube_scraper ⭐ 18

Scrape data about an entire Channel or just a Playlist, or get stats about your Own Watch History.

Amazon_product_scrap ⭐ 18

Amazon product Scraping using Django and Selenium

Covid 19 ⭐ 16

Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.

Fbscraper ⭐ 15

Python scripts for scraping various data from Newegg.com and storing it in an SQLite database.

Scraperwiki Ruby ⭐ 12

ScraperWiki Ruby library for scraping and saving data

Scrapyd Mongodb ⭐ 12

Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management

Prntscr Scraper ⭐ 12

A web scraper designed to link prntscr.com URLs with their associated Imgur images, and archive them.

Precios Claros ⭐ 11

Precios Claros (http://preciosclaros.gob.ar) scraper / data downloader

Meta Spy ⭐ 10

👾 CLI MetaSpy (Facebook, Instagram) scraper and crawler - instagram account, facebook accounts, pages and search

Advanced Play Search ⭐ 9

Search Google Platy Store with many filters

Isoxya Api ⭐ 9

Isoxya Crawler API

Kimurai Dashboard ⭐ 7

Simple dashboard for Kimurai web scraping framework

Nepali News Portal Kbd ⭐ 7

Online webapp that scrapes news from different new portals of Nepal and worldwide. Hosted at heroku.

Furaffinityscraper ⭐ 6

a scraper of furaffinity.net written with python

Myfitnesspal ⭐ 6

A python script for scraping the diary data from MyFitnessPal and putting it into a SQLite database

Web Scraping Box Office Mojo ⭐ 6

for each year scraped the table and collected all tables and made sqlite database.

Weather in d3js (again).

Coronavirusdatabase ⭐ 5

I have used web scraping to collect the data and stored it into a .json file and further using the .json file to add to SQLite Database and also trying to make an API using Flask.

Music Scraper ⭐ 5

Python Reddit music scraper

Opensource Tracker ⭐ 5

Opensource scraper for analyse of social networks. Create nodes with egdes for you to visualize on editors like gephi.

Simple betfair python scripts

Related Searches

Python Scraper (3,513)

Database Sqlite (2,725)

Python Sqlite (2,683)

Javascript Scraper (2,047)

Scraper Scrape (1,534)

Scraper Web Crawler (1,528)

Javascript Sqlite (973)

Java Sqlite (972)

Mysql Sqlite (923)

Scraper Crawler (904)

1-21 of 21 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.