Awesome Open Source

Programming Languages

Search results for scraper wget

11 search results found

Awesome Datahoarding ⭐ 892

List of data-hoarding related tools

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Goscrape ⭐ 172

Web scraper that can create an offline readable version of a website

Wget Lua ⭐ 72

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Web Scrapers ⭐ 12

various web scrapers as examples

Aria2 Recursive Scraper ⭐ 10

A simple scraper and bash script combination to download open directories recursively using aria2 instead of wget.

Crawling Emails ⭐ 8

Very simple bash script to crawl email addresses from a specific website.

Downloads all PDFs on a webpage (for lazy people)

⚡ The fastest 4chan multi-threaded files downloader in golang

Aria2 Scraper ⭐ 5

scrapes and downloads over multiple connections using aria2, wget and awk

CLI tool to download folders/ repo with ease, without any token!

Related Searches

Python Scraper (3,513)

Javascript Scraper (2,047)

Scraper Scrape (1,534)

Scraper Web Crawler (1,397)

Scraper Crawler (904)

Shell Wget (536)

Golang Scraper (410)

Python Wget (395)

Html Scraper (383)

1-11 of 11 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.