Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Framework Scraper Open Source Projects

Open source projects categorized as Framework Scraper
Categories > Frameworks > Framework
Categories > Data Processing > Scraper
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 3 months agopypi Scrapy} Downloads
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22most recent commit a month ago
Webmagic ⭐ 11,080
A scalable web crawler framework for Java.
dependent packages 22total releases 25most recent commit 3 months ago
Grab ⭐ 2,292
Web Scraping Framework
dependent packages 3total releases 120most recent commit 10 months agopypi grab} Downloads
Pjscrape ⭐ 1,003
A web-scraping framework written in Javascript, using PhantomJS and jQuery
most recent commit 9 years ago
Operative Framework ⭐ 661
operative framework is a rust investigation OSINT framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
most recent commit 4 months ago
Nodejs Stuff ⭐ 484
Node.js libs I want to keep in mind.
most recent commit 4 years ago
Webster ⭐ 465
a reliable high-level web crawling & scraping framework for Node.js.
dependent packages 2total releases 42most recent commit 6 months agonpm webster} Downloads
Dude ⭐ 397
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
total releases 43most recent commit 3 months ago
Sasila ⭐ 264
一个灵活、友好的爬虫框架
total releases 17most recent commit 5 years ago
Transistor ⭐ 209
Transistor, a Python web scraping framework for intelligent use cases.
total releases 7most recent commit 4 months ago
Scrapyz ⭐ 188
"Scrape Easy" - an extension of the Scrapy framework.
total releases 6most recent commit 8 years ago
Antch ⭐ 177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
dependent packages 1total releases 1most recent commit 4 years ago
Pastepwn ⭐ 109
Python framework to scrape Pastebin pastes and analyze them
total releases 22most recent commit a year ago
Bots Zoo ⭐ 90
most recent commit 5 months ago
Venom ⭐ 73
Your preferred open source focused crawler for the deep web.
total releases 21most recent commit 10 months ago
Scraping Ebay ⭐ 73
Scraping Ebay's products using Scrapy Web Crawling Framework
most recent commit 2 years ago
Pomp ⭐ 60
Screen scraping and web crawling framework
most recent commit 7 years ago
Scraperx ⭐ 53
Library for scraping websites or apis at any scale
total releases 75most recent commit 7 months ago
Reddit ⭐ 44
Scrapy (Python Framework) Example using reddit.com
most recent commit 6 years ago
Foundation ⭐ 31
🧱 A uniform template to use as a foundation for Puppeteer bot construction.
most recent commit 3 years ago
Script.module.codequick ⭐ 29
Kodi addon framework
most recent commit 10 months ago
Ioweb ⭐ 28
Web Scraping Framework
total releases 26most recent commit 2 years ago
The 10 Most Depended On Framework Scraper Open Source Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Webmiddle ⭐ 13
Node.js framework for modular web scraping and data extraction
dependent packages 27total releases 9latest release November 06, 2018most recent commit 4 years agonpm webmiddle} Downloads
Webmagic ⭐ 11,080
A scalable web crawler framework for Java.
dependent packages 22total releases 25latest release September 10, 2023most recent commit 3 months ago
Grab ⭐ 2,292
Web Scraping Framework
dependent packages 3total releases 120latest release June 24, 2018most recent commit 10 months agopypi grab} Downloads
Aragog ⭐ 9
Distributed web scraping framework
dependent packages 2total releases 9latest release December 15, 2021most recent commit 2 years agonpm aragog-client} Downloads
Scruber ⭐ 6
Ruby crawling framework
dependent packages 2total releases 9latest release September 06, 2018most recent commit 6 years agorubygems scruber} Downloads
Webster ⭐ 465
a reliable high-level web crawling & scraping framework for Node.js.
dependent packages 2total releases 42latest release November 09, 2023most recent commit 6 months agonpm webster} Downloads
Antch ⭐ 177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
dependent packages 1total releases 1latest release December 25, 2017most recent commit 4 years ago
Crawling Framework ⭐ 21
Easily crawl news portals or blog sites using Storm Crawler.
dependent packages 1total releases 1latest release September 19, 2017most recent commit 3 years ago
The 10 Latest Releases In Framework Scraper Open Source Projects
Seer ⭐ 7
A PHP XPath based web scraping framework.
latest release December 07, 2023most recent commit 9 years ago
Webster ⭐ 465
a reliable high-level web crawling & scraping framework for Node.js.
dependent packages 2total releases 42latest release November 09, 2023most recent commit 6 months agonpm webster} Downloads
Scraperx ⭐ 53
Library for scraping websites or apis at any scale
total releases 75latest release September 25, 2023most recent commit 7 months ago
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Webmagic ⭐ 11,080
A scalable web crawler framework for Java.
dependent packages 22total releases 25latest release September 10, 2023most recent commit 3 months ago
Dude ⭐ 397
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
total releases 43latest release August 12, 2023most recent commit 3 months ago
Katatachi ⭐ 7
A Python framework to build web scraping applications.
total releases 99latest release July 19, 2022most recent commit a year ago
Scrapio ⭐ 16
Asyncio web crawling framework. Work in progress.
total releases 9latest release July 09, 2022most recent commit 9 months ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Aragog ⭐ 9
Distributed web scraping framework
dependent packages 2total releases 9latest release December 15, 2021most recent commit 2 years agonpm aragog-client} Downloads
Popular Frameworks Categories
Laravel
Django
Ruby On Rails
Spring
Express
Spring Boot
Flask
Nextjs
Play Framework
Symfony
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.