Awesome Open Source

Programming Languages

Search results for crawler downloader

72 search results found

👾 Fast and simple video download library and CLI tool written in Go

Work_crawler ⭐ 2,671

Download comics novels 小说漫画下载工具小説漫画のダウンローダ小說漫畫下載:腾讯漫画大角虫漫画有妖气咪咕 SF漫画哦漫画看漫画漫画柜汗汗酷漫動漫伊甸園快看漫画微博动漫 733动漫网大古漫画网漫画DB 無限動漫動漫狂卡推漫画动漫之家动漫屋古风漫画网 36漫画网亲亲漫画网乙女漫画 webtoons 咚漫ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミックサイコミ;アルファポリスカクヨムハーメルン小説家になろう起点中文网八一中文网顶点小说落霞小说网努努书坊笔趣阁→epub.

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

Tumblthree ⭐ 922

A Tumblr Blog Backup Application

Awesome Datahoarding ⭐ 892

List of data-hoarding related tools

Scrawler ⭐ 882

🏳️‍🌈 Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.

Icrawler ⭐ 792

A multi-thread crawler framework with many builtin image crawlers provided.

[Unmaintained] A simple and clean video/music/image downloader 👾

Netdiscovery ⭐ 557

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

Tumblthree ⭐ 552

A Tumblr and Twitter Blog Backup Application

Moodle Dl ⭐ 355

Moodle-DL downloads course content fast from Moodle (eg. lecture pdfs)

Xhs Spider ⭐ 296

小红书数据采集、网站图片、视频资源批量下载工具，颜值超高的数据采集工具（批量下载，视频提取，图片，去

一个灵活、友好的爬虫框架

4chan Downloader ⭐ 251

Python3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation

Jmcomic Crawler Python ⭐ 247

Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

Tiktok Downloader ⭐ 223

Tiktok Downloader/Scraper using requests & bs4

golang light-weight image crawler

Ceiba Downloader ⭐ 139

This is a course-downloader to help NTU students download courses data from NTU Ceiba.

Copymanga Downloader ⭐ 134

使用python编译exe/bash/命令行参数来下载copymanga(拷贝漫画)中的漫画，支持批

Python Dcdownloader ⭐ 133

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

Massivedl ⭐ 125

Download a large list of files concurrently

Sina Weibo Album Downloader ⭐ 125

Multithreading download all HD photos / pictures from someone's Sina Weibo album.

Dl_coursera ⭐ 119

A simple, fast, and reliable Coursera crawling & downloading tool

Recursive Goindex Downloader ⭐ 107

Simple GoIndex Downloader

Blinkist M4a Downloader ⭐ 97

Grabs all of the audio files from all of the Blinkist books

Android Apps Crawler ⭐ 88

An extensible crawler for downloading Android applications in third-party markets.

Google Arts Crawler ⭐ 82

Google Arts & Culture high quality image downloader

Wget Lua ⭐ 72

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Dotnetcrawler ⭐ 63

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-w

可配置的小说下载及电子书生成工具

Fetchman ⭐ 61

fetchman is a simple crawler system/简单好用的爬虫框架

Recruitment ⭐ 57

A project crawling online recruitment websites getting offer information

Tumbltwo ⭐ 56

TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.

Cyworld Bot ⭐ 54

🤖 Cyworld image crawler

Lezhin Comics Downloader ⭐ 48

📥 Downloader for lezhin comics

Slideshare Downloader ⭐ 41

Python script to download slideshare pdf. This script able to download slide and converted into pdf automatically.

sponge is a website crawler and links downloader command-line tool

Coomer| kemono .party or su downloader

Tse Client ⭐ 30

A client for fetching stock data from the Tehran Stock Exchange (TSETMC). Works in Browser, Node and as CLI.

Google Image Downloader ⭐ 28

A script to download images from images.google.com

Kissanime_dl ⭐ 26

web-crawler / package manager / kissanime downloader

Moodle Downloader ⭐ 26

A Moodle Crawler that downloads course content from Moodle (eg. lecture pdfs)

Instagram Downloader ⭐ 24

Instagram user's photos and videos downloader. Download all media files from any username. Working 2021!

Coursera_spider ⭐ 23

A Simple spider that use to crawl the Coursera video and pdf links and downloader script

Download public videos on TikTok using Python with Selenium

Koromo Copy App ⭐ 19

Cross-Platform program to extract images, text, music from many sites

Chan Downloader ⭐ 18

CLI to download all images/webms in a 4chan thread

Iloveptt ⭐ 18

我愛批踢踢 A PTT Crawler and Photo downloader which written in Golang

Pdf_downloader ⭐ 17

A Scrapy Spider for downloading PDF files from a webpage.

A simple and flexible web crawler framework for java.

Douyin Crawler ⭐ 16

抖音爬虫. 通过手机代理爬取用户的作品和用户的喜欢

A simple, open-source, easy to use, and free download manager for malware samples.

Twitterstream Downloader ⭐ 15

Twitter stream and social network crawling tools

Godownloader ⭐ 15

downloader service by golang

Codeschool Downloader ⭐ 14

💯 Automation Download codeschool all videos, build with python and selenium

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

Book Spider ⭐ 14

🎉 开箱即用的高性能可自定义的笔趣阁小说爬虫快速下载无广告小说

Instagram Downloader ⭐ 13

Node.js/Express app to retrive instagram video/image download urls

Cr_manga_downloadr ⭐ 12

Second version of the Ruby version of my MangaReader.net crawler adapted for Crystal

instagram bulk profile media downloader - scrape from picuki.com

Crawlers ⭐ 11

Crawlers for mostly news providers

Mangareader Downloader V2 ⭐ 11

This program can download stuff from mangareader.to

Poster Finder ⭐ 10

Download All Poster of Movie with URL

Twitter Downloader ⭐ 10

Twitter Picture Crawler

Metagoofeel ⭐ 10

Web crawler and downloader based on GNU Wget.

Simple Manga Downloader, a tool to search and download manga

Node Vgmusic Downloader ⭐ 9

Node.js tool for downloading all free MIDI files on VGMusic.com

Abyss Watcher ⭐ 9

Abyss Watcher - Malware Downloader

Images Downloader ⭐ 9

A Node.js module for downloading a single image or multiple images to disk from a given Url

Spider To Bttt.la ⭐ 9

Apkcrawler ⭐ 8

Android APK Crawler

Handout Downloader ⭐ 8

📥 Download entire directories from the @fh-wedel handout server.

Awesome Scrapy ⭐ 8

🕶 Awesome list of Scrapy tools and libraries

Proxy Hentai Downloader ⭐ 7

This is a python project for image download from e-hentai and exhentai galleries while automatically searching for proxies.

Comprehensive Manga Downloader ⭐ 6

This is a command line utility tool to browse, search, download chapters, and convert to a final PDF manga from

Flaticon Picker ⭐ 6

Flaticon Picker & Downloader - Flaticon Collection

Codeforces Solutions Downloader ⭐ 6

Download accepted solutions from Codeforces for any username

Csdnblogdownloader ⭐ 6

CSDN Blog Downloader

Wasapi Downloader ⭐ 5

Java application to download WARCs from WASAPI

Manga_downloader ⭐ 5

Simple MangaReader.net crawler written in Go

Python Gadgets ⭐ 5

python excise, python gadgets

Genshin Impact Offical Comic Downloader ⭐ 5

This tool can crawl every single page of the Genshin Impact comic from the Official Genshin website.

dw speeds up manual malware hunting tasks like href crawling, automatic file download and vendor submission.

Py Lightshot Dowloader ⭐ 5

Random Lightshot image downloader

Reddit Crawler ⭐ 5

The "Reddit Image Crawler" is a Python script that facilitates the extraction and downloading of image and gifs URLs from a specified subreddit on Reddit. It also includes functionalities to download the images from the fetched URLs, handle duplicate image removal, and rename image files in a directory.

Related Searches

Python Crawler (4,528)

Python Downloader (2,321)

Javascript Crawler (1,142)

Crawler Spider (1,086)

Crawler Scrapy (988)

Javascript Downloader (919)

Scraper Crawler (863)

Java Crawler (807)

Youtube Downloader (727)

1-72 of 72 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.