The Top 23 Scraper Scrape Open Source Projects

Open source projects categorized as Scraper Scrape

Categories > Scrape

Categories > Data Processing > Scraper

Portia ⭐ 8,982

Visual scraping for Scrapy

dependent packages 2total releases 26most recent commit 7 months ago

Autoscraper ⭐ 5,159

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

dependent packages 1total releases 16most recent commit a year ago

Scraperjs ⭐ 3,575

A complete and versatile web scraper.

dependent packages 39total releases 15most recent commit 7 years ago

Tiktok Scraper ⭐ 3,554

TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.

dependent packages 18total releases 91most recent commit a year ago

Facebook Page Post Scraper ⭐ 2,014

Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis

most recent commit 5 years ago

Facebook Scraper ⭐ 1,936

Scrape Facebook public pages without an API key

dependent packages 7total releases 76most recent commit 6 months ago

Twitterscraper ⭐ 1,852

Scrape Twitter for Tweets

dependent packages 1total releases 47most recent commit 3 years ago

Scrapely ⭐ 1,668

A pure-python HTML screen-scraping library

dependent packages 2total releases 13most recent commit 4 years ago

Upton ⭐ 1,615

A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)

dependent packages 1total releases 20most recent commit 5 years ago

Linkedin_scraper ⭐ 1,534

A library that scrapes Linkedin for user data

total releases 42most recent commit 3 months ago

Jobfunnel ⭐ 1,533

Scrape job websites into a single spreadsheet with no duplicates.

total releases 1most recent commit 2 years ago

Scrape ⭐ 1,464

A simple, higher level interface for Go web scraping.

dependent packages 15total releases 1most recent commit 7 years ago

How To Prevent Scraping ⭐ 1,417

The ultimate guide on preventing Website Scraping

most recent commit 4 months ago

Loklak_scraper_js ⭐ 1,094

Scrapers for loklak in javascript

most recent commit 5 years ago

Redditdownloader ⭐ 1,045

Scrapes Reddit to download media of your choice.

most recent commit 10 months ago

Pjscrape ⭐ 1,003

A web-scraping framework written in Javascript, using PhantomJS and jQuery

most recent commit 9 years ago

Mlscraper ⭐ 935

🤖 Scrape data from HTML websites automatically by just providing examples

total releases 4most recent commit a year ago

Twitter Scraper ⭐ 769

Scrape the Twitter frontend API without authentication with Golang.

dependent packages 13total releases 23most recent commit 5 months ago

Scweet ⭐ 720

A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...

dependent packages 1total releases 15most recent commit a year ago

Skrape.it ⭐ 714

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

dependent packages 3total releases 14most recent commit 4 months ago

Robintrack ⭐ 679

Scrapes the Robinhood API to retrieve + store popularity and price data.

most recent commit 3 months ago

Voyager ⭐ 618

crawl and scrape web pages in rust

total releases 4most recent commit 10 months ago

Javmoviescraper ⭐ 618

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent

most recent commit 4 years ago

The 10 Most Depended On Scraper Scrape Open Source Projects

Web Scraper ⭐ 97

Perl web scraping toolkit

dependent packages 52total releases 38latest release October 20, 2014most recent commit 7 years ago

Scraperjs ⭐ 3,575

A complete and versatile web scraper.

dependent packages 39total releases 15latest release December 14, 2015most recent commit 7 years ago

Tiktok Scraper ⭐ 3,554

TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.

dependent packages 18total releases 91latest release August 14, 2021most recent commit a year ago

Instagram Scraper ⭐ 367

Instagram Scraper. Scrape useful data/posts from instagram users, hashtag and locations pages. Comments and people who liked specific posts and soon more. No login or API keys are required

dependent packages 15total releases 67latest release November 10, 2022most recent commit a year ago

Scrape ⭐ 1,464

A simple, higher level interface for Go web scraping.

dependent packages 15total releases 1latest release November 28, 2016most recent commit 7 years ago

Extension ⭐ 32

web scraping extension

dependent packages 13total releases 7latest release September 26, 2020most recent commit a year ago

npm get-set-fetch-extension-commons} Downloads

Twitter Scraper ⭐ 769

Scrape the Twitter frontend API without authentication with Golang.

dependent packages 13total releases 23latest release April 23, 2021most recent commit 5 months ago

Core ⭐ 86

:spider: The PHP SERP Spider - A search engine scraper

dependent packages 13total releases 13latest release February 22, 2020most recent commit 2 years ago

Node Metainspector ⭐ 124

Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainspector Ruby gem

dependent packages 9total releases 8latest release February 16, 2019most recent commit 5 years ago

Images Scraper ⭐ 218

Simple and fast scraper for Google

dependent packages 9total releases 34latest release November 13, 2022most recent commit 3 months ago

The 10 Latest Releases In Scraper Scrape Open Source Projects

Scraperboard ⭐ 94

Golang library to easily scrape websites based on simple XML declarations

latest release November 26, 2023most recent commit 9 years ago

Kenpompy ⭐ 61

A simple yet comprehensive web scraper for kenpom.com.

total releases 9latest release November 22, 2023most recent commit 4 months ago

Stack Scraper ⭐ 61

dependent packages 1total releases 4latest release November 05, 2023most recent commit 5 months ago

Hockey Scraper ⭐ 134

Python Package for scraping NHL Play-by-Play and Shift data

total releases 55latest release October 30, 2023most recent commit 4 months ago

Noscrape ⭐ 32

obfuscate text via node to make scraping your content really difficult

dependent packages 2total releases 20latest release September 28, 2023most recent commit 3 months ago

Zubbi ⭐ 16

Index for finding jobs & roles used in a Zuul based CI system

total releases 22latest release August 24, 2023most recent commit 3 months ago

Skraper ⭐ 217

Kotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, Coub, Vimeo, IFunny, VK, Odnoklassniki, Pikabu)

total releases 13latest release August 21, 2023most recent commit 3 months ago

Scrapyteer ⭐ 9

Web crawling & scraping framework for Node.js on top of headless Chrome browser

total releases 8latest release June 07, 2023most recent commit 9 months ago

Mwoffliner ⭐ 245

Mediawiki scraper: all your wiki articles in one highly compressed ZIM file

dependent packages 2total releases 400latest release May 24, 2023most recent commit 3 months ago

Nudecrawler ⭐ 231

Crawl telegra.ph searching for nudes!

total releases 38latest release April 30, 2023most recent commit 7 months ago