Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Driveit

A New Multithreading Crawler Supports Multiple Websites
Stars
94
License
wtfpl
Open Issues
1
Most Recent Commit
7 years ago
Programming Language
Python
Categories
Repo
Alternatives To Driveit
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Gau3,27314 months ago31November 02, 202322mitGo
Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.
Pystock Crawler299
12 years ago14October 19, 20144mitPython
Crawl and parse financial reports (XBRL) from SEC EDGAR, and daily stock prices from Yahoo Finance
Python Automation Scripts264
3 years agogpl-3.0Python
Simple yet powerful automation stuffs.
Galer189
a year ago2November 05, 20215mitGo
A fast tool to fetch URLs from HTML attributes by crawl-in.
Scraply114
2 years ago1July 07, 2022apache-2.0Go
Scraply a simple dom scraper to fetch information from any html based website
Driveit94
7 years ago1wtfplPython
A New Multithreading Crawler Supports Multiple Websites
Ferrit60
10 years ago2mitScala
Ferrit is a web crawler service written in Scala using Akka, Spray and Cassandra.
Spiderman49npm spiderman-crawler} Downloads110 years ago10July 10, 2014JavaScript
a crawler with visualized config board
Anilist Crawler43
3 months agomitJavaScript
Crawl data from anilist API and store in MariaDB.
Relspider28
10 years ago6JavaScript
A web crawler that indexes the identity/social graph of profiles on the web
Alternatives To Driveit
Select To Compare
Spiderman ⭐ 49
a crawler with visualized config board
dependent packages 1total releases 10most recent commit 10 years agonpm spiderman-crawler} Downloads


Suggest An Alternative To DriveIt
Alternative Project Comparisons
Driveit vs Gau
Driveit vs Pystock Crawler
Driveit vs Python Automation Scripts
Driveit vs Galer
Driveit vs Scraply
Driveit vs Ferrit
Driveit vs Spiderman
Driveit vs Anilist Crawler
Driveit vs Relspider
Popular Crawler Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40latest release November 06, 2023most recent commit 16 days ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Popular Fetch Projects
Swr ⭐ 29,304
React Hooks for Data Fetching
dependent packages 1,110total releases 157latest release September 25, 2023most recent commit 9 days agonpm swr} Downloads
Fetch ⭐ 25,801
A window.fetch JavaScript polyfill.
dependent packages 9,330total releases 50latest release September 11, 2023most recent commit 10 days agonpm whatwg-fetch} Downloads
Ky ⭐ 11,014
🌳 Tiny & elegant JavaScript HTTP client based on the browser Fetch API
dependent packages 456total releases 67latest release November 01, 2023most recent commit 3 months agonpm ky} Downloads
Node Fetch ⭐ 8,623
A light-weight module that brings the Fetch API to Node.js
dependent packages 37,424total releases 96latest release August 23, 2023most recent commit a month agonpm node-fetch} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Crawler
Fetch
Comic
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.