Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Extraction Scraper Open Source Projects

Open source projects categorized as Extraction Scraper
Categories > Data Processing > Extraction
Categories > Data Processing > Scraper
Newspaper ⭐ 13,147
News, full-text, and article metadata extraction in Python 3. Advanced docs:
dependent packages 97total releases 18most recent commit 7 months agopypi newspaper3k} Downloads
Scrapely ⭐ 1,668
A pure-python HTML screen-scraping library
dependent packages 2total releases 13most recent commit 4 years agopypi scrapely} Downloads
Wombat ⭐ 1,297
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
dependent packages 5total releases 33most recent commit 3 months agorubygems wombat} Downloads
Article Extractor ⭐ 1,297
To extract main article from given URL with Node.js
dependent packages 10total releases 156most recent commit 3 months agonpm article-parser} Downloads
Parsel ⭐ 1,010
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
dependent packages 152total releases 22most recent commit 7 months agopypi parsel} Downloads
Web Scraper Chrome Extension ⭐ 980
Web data extraction tool implemented as chrome extension
most recent commit 5 years ago
Mlscraper ⭐ 935
🤖 Scrape data from HTML websites automatically by just providing examples
total releases 4most recent commit a year ago
Social Media Profiles Regexs ⭐ 508
📇 Extract social media profiles and more with regular expressions
most recent commit a year ago
Alltheplaces ⭐ 502
A set of spiders and scrapers to extract location information from places that post their location on the internet.
most recent commit 3 months ago
Openwebtext ⭐ 463
Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.
most recent commit a year ago
Scrapple ⭐ 452
A framework for creating semi-automatic web content extractors
total releases 10most recent commit 5 years ago
Php Goose ⭐ 447
Readability / Html Content / Article Extractor & Web Scrapping library written in PHP
dependent packages 2total releases 22most recent commit 8 months agopackagist scotteh/php-goose} Downloads
Ruiji.net ⭐ 261
crawler framework, distributed crawler extractor
total releases 21most recent commit 4 months ago
Graphql Scraper ⭐ 164
Extract structured data from the web using GraphQL.
most recent commit 6 years ago
Xquery ⭐ 155
Extract data or evaluate value from HTML/XML documents using XPath
dependent packages 92total releases 2most recent commit 6 years ago
Web Scraper Chrome Extension ⭐ 149
Web data extraction tool implemented as chrome extension
most recent commit 9 months ago
Sqrape ⭐ 145
Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
total releases 1most recent commit 8 years ago
Nibbler ⭐ 142
A cute HTML scraper / data extraction tool in under 70 lines of code
dependent packages 9total releases 5most recent commit 8 years agorubygems nibbler} Downloads
News Fetch ⭐ 140
A Python Package which helps to scrape all news details from any news websites
total releases 28most recent commit 9 months ago
Email Extractor ⭐ 134
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
most recent commit a year ago
Serpscrap ⭐ 125
SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
total releases 36most recent commit 5 years ago
Evine ⭐ 117
Interactive CLI Web Crawler
total releases 8most recent commit 3 years ago
Html2rss ⭐ 106
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
total releases 20most recent commit 4 months ago
The 10 Most Depended On Extraction Scraper Open Source Projects
Parsel ⭐ 1,010
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
dependent packages 152total releases 22latest release April 18, 2023most recent commit 7 months agopypi parsel} Downloads
Newspaper ⭐ 13,147
News, full-text, and article metadata extraction in Python 3. Advanced docs:
dependent packages 97total releases 18latest release September 28, 2018most recent commit 7 months agopypi newspaper3k} Downloads
Xquery ⭐ 155
Extract data or evaluate value from HTML/XML documents using XPath
dependent packages 92total releases 2latest release May 15, 2018most recent commit 6 years ago
Youtube Playlist ⭐ 31
:snowflake: Extract links, ids, and names from a youtube playlist
dependent packages 14total releases 5latest release July 19, 2020most recent commit 4 years agonpm youtube-playlist} Downloads
Extension ⭐ 32
web scraping extension
dependent packages 13total releases 7latest release September 26, 2020most recent commit a year agonpm get-set-fetch-extension-commons} Downloads
Article Extractor ⭐ 1,297
To extract main article from given URL with Node.js
dependent packages 10total releases 156latest release December 01, 2022most recent commit 3 months agonpm article-parser} Downloads
Nibbler ⭐ 142
A cute HTML scraper / data extraction tool in under 70 lines of code
dependent packages 9total releases 5latest release January 17, 2012most recent commit 8 years agorubygems nibbler} Downloads
Node Scrape ⭐ 5
A configurable node package for scraping web page content.
dependent packages 5total releases 7latest release September 21, 2014most recent commit 9 years agonpm node-scrape} Downloads
Wombat ⭐ 1,297
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
dependent packages 5total releases 33latest release September 03, 2019most recent commit 3 months agorubygems wombat} Downloads
Google Scraper ⭐ 38
Extract links from Google SERP
dependent packages 5total releases 22latest release December 30, 2016most recent commit 7 years agonpm google-scraper} Downloads
The 10 Latest Releases In Extraction Scraper Open Source Projects
Scraperboard ⭐ 94
Golang library to easily scrape websites based on simple XML declarations
latest release November 26, 2023most recent commit 9 years ago
Web Poet ⭐ 85
Web scraping Page Objects core library
dependent packages 4total releases 23latest release November 21, 2023most recent commit 3 months agopypi web-poet} Downloads
Parsel ⭐ 1,010
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
dependent packages 152total releases 22latest release April 18, 2023most recent commit 7 months agopypi parsel} Downloads
Article Extractor ⭐ 1,297
To extract main article from given URL with Node.js
dependent packages 10total releases 156latest release December 01, 2022most recent commit 3 months agonpm article-parser} Downloads
Mlscraper ⭐ 935
🤖 Scrape data from HTML websites automatically by just providing examples
total releases 4latest release June 24, 2022most recent commit a year ago
Scraper ⭐ 15
All In One API to easily scrape data from any website, without worrying about captchas and bot detection mecanisms.
dependent packages 2total releases 12latest release September 02, 2021most recent commit 9 months agonpm @dopamyn/scraper} Downloads
Go Playstore Scraper ⭐ 7
An API and a web scraper lib for the Playstore
total releases 9latest release August 25, 2021most recent commit 3 years ago
Youtubesearchapi.net ⭐ 12
A lightweight & simple library to extract data from Youtube or any sources
total releases 5latest release August 24, 2021most recent commit 2 years ago
Seo Scraper ⭐ 22
Scrape SEO elements or whatever you need with this scraper built in Node.js
total releases 6latest release August 07, 2021most recent commit 2 years ago
Quora Loader ⭐ 9
A realtime read-only locator and extraction library for Quora questions and answers.
total releases 9latest release February 21, 2021most recent commit 8 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.