Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scrapper Open Source Projects

Open source projects categorized as Scrapper
Categories > Scrapper
Comic Dl ⭐ 498
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
total releases 10most recent commit 8 months ago
Tinking ⭐ 337
🧶 Extract data from any website without code, just clicks.
most recent commit 3 years ago
Stweet ⭐ 308
Advanced python library to scrap Twitter (tweets, users) from unofficial API
total releases 20most recent commit a year ago
Web Scraping ⭐ 276
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
most recent commit 2 years ago
Proxy Scraper ⭐ 260
scrape proxies from more than 5 different sources and check which ones are still alive
most recent commit a year ago
Thescrapper ⭐ 161
Scrape emails, phone numbers and social media accounts from a website.
most recent commit 7 months ago
Xvideos ⭐ 147
xvideos API library
dependent packages 2total releases 9most recent commit 2 years agonpm @rodrigogs/xvideos} Downloads
Email Extractor ⭐ 134
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
most recent commit a year ago
Udemycoursegrabber ⭐ 125
Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
most recent commit 3 years ago
Meta Fetcher ⭐ 125
simple metadata scrapper for node.js
dependent packages 2total releases 9most recent commit 3 years agonpm meta-fetcher} Downloads
Leetcode Questions Scraper ⭐ 117
Scrape Algorithm Questions from leetcode and generate html and epub file
most recent commit 4 months ago
Geeksforgeeksscrapper ⭐ 116
Scrapes g4g and creates PDF
most recent commit 4 years ago
Seleniumcrawler ⭐ 105
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
most recent commit 5 years ago
Mytelegramorgrobot ⭐ 100
most recent commit a year ago
Xvideos Pornhub Redtube Api ⭐ 84
This script scrapes the HTML from different web pages to get the information from the video (XVideos, PornHub, RedTube) and you can use it in your own video player.
most recent commit 8 months ago
Proxy List Scrapper ⭐ 72
Proxy List Scrapper
most recent commit a year ago
Goscraper ⭐ 58
Golang pkg to quickly return a preview of a webpage (title/description/images)
dependent packages 6total releases 1most recent commit 4 years ago
Node Urlresolver Api ⭐ 53
A complete nodejs API to extract streaming sites video direct URLs
most recent commit 2 years ago
Goquotes ⭐ 49
A Go scraper aimed at scrapping quotes.
most recent commit 3 years ago
Instagram To Discord ⭐ 49
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2021!
most recent commit 3 years ago
Tweet_scrapper ⭐ 45
Scrape the Twitter frontend API without any authentication and restriction.
total releases 15most recent commit 5 years ago
Apsoft Web Scanner V2 ⭐ 43
Powerful dork searcher and vulnerability scanner for windows platform
most recent commit 3 years ago
Goclone ⭐ 41
🌱 goclone - clone websites in a matter of seconds
total releases 3most recent commit 6 months ago
The 10 Most Depended On Scrapper Open Source Projects
Goscraper ⭐ 58
Golang pkg to quickly return a preview of a webpage (title/description/images)
dependent packages 6total releases 1latest release August 27, 2019most recent commit 4 years ago
Xvideos ⭐ 147
xvideos API library
dependent packages 2total releases 9latest release January 16, 2022most recent commit 2 years agonpm @rodrigogs/xvideos} Downloads
Chupa Cabra ⭐ 30
NodeJS tool to get data from site or API and concatenate to a file.
dependent packages 2total releases 16latest release January 19, 2017most recent commit 7 years agonpm chupa-cabra} Downloads
Insta_scrape_insta ⭐ 6
>Extract Instagram User Information, Post Information Without Login in the form of a .json file or a javaScript Object.
dependent packages 2total releases 7latest release November 19, 2018most recent commit 5 years agonpm insta_scrape_insta} Downloads
Fatec Api ⭐ 36
API for SIGA from Centro Paula Souza made for students to create things based in their profile data
dependent packages 2total releases 19latest release August 10, 2020most recent commit 3 years agonpm fatec-api} Downloads
Meta Fetcher ⭐ 125
simple metadata scrapper for node.js
dependent packages 2total releases 9latest release June 12, 2021most recent commit 3 years agonpm meta-fetcher} Downloads
Statusinvest ⭐ 35
:money_with_wings: statusinvest.com.br stocks info web scraper
dependent packages 1total releases 1latest release September 26, 2021most recent commit a year agonpm statusinvest} Downloads
Jwht Htmltopojo ⭐ 6
Fully Featured, highly pluggable and customizable Java Html to Pojo converter.
dependent packages 1total releases 3latest release August 10, 2018most recent commit 5 years ago
Meuguia.js ⭐ 5
:tv: meuguia.TV as npm module
dependent packages 1total releases 4latest release November 04, 2018most recent commit 5 years agonpm meuguia} Downloads
Storexplore ⭐ 19
Transform online stores into APIs !
dependent packages 1total releases 8latest release December 17, 2016most recent commit 5 years agorubygems storexplore} Downloads
The 10 Latest Releases In Scrapper Open Source Projects
Laravel Block Bots ⭐ 34
Block crawlers and high traffic users on your site by IP using Redis
total releases 28latest release September 21, 2023most recent commit 7 months ago
Universal Pdp Scrapper ⭐ 5
A universal pdp scrapper using cheerio & ChatGPT
total releases 11latest release August 25, 2023most recent commit 10 months ago
Goclone ⭐ 41
🌱 goclone - clone websites in a matter of seconds
total releases 3latest release July 09, 2023most recent commit 6 months ago
Tiktok Api Php ⭐ 11
TikTok REST API wrapper for PHP
total releases 2latest release June 16, 2023most recent commit 9 months ago
Stweet ⭐ 308
Advanced python library to scrap Twitter (tweets, users) from unofficial API
total releases 20latest release February 06, 2023most recent commit a year ago
Site Cloner ⭐ 5
Quick & simple Python tool to clone website
total releases 1latest release October 16, 2022most recent commit a year ago
Tiktok Private Api Php ⭐ 6
Unofficial Access to Private TikTok API
total releases 3latest release June 13, 2022most recent commit 2 years ago
Tradingview Ws ⭐ 21
TradingView data fetcher through websockets.
total releases 3latest release March 26, 2022most recent commit a year ago
Xvideos ⭐ 147
xvideos API library
dependent packages 2total releases 9latest release January 16, 2022most recent commit 2 years agonpm @rodrigogs/xvideos} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.