Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scraper Webscraper Open Source Projects

Open source projects categorized as Scraper Webscraper
Categories > Data Processing > Scraper
Categories > Webscraper
Words Scraper ⭐ 19
Selenium based web scraper to generate passwords list
most recent commit 4 years ago
Aiess ⭐ 18
A web scraper and discord bot for osu! mapping/modding related event feeds.
most recent commit 3 months ago
Essaygen ⭐ 18
Essay generator
most recent commit 2 years ago
Ptt Crawler ⭐ 18
ptt-crawler is a web crawler module designed to scarpe data from Ptt.
total releases 12most recent commit a year ago
Openai Scraper ⭐ 18
This is a template repository for building a web scraper with OpenAI support. The repository provides a basic project structure with TypeScript and Puppeteer pre-configured, as well as OpenAI's GPT-3 API integration. With this template, you can easily build a scraper that uses machine learning to analyze and extract insights from the scraped data.
most recent commit 3 months ago
Sinaweiboscraper ⭐ 18
Web Scraper for Sina Weibo Search by Keywords
most recent commit 7 years ago
Scrape ⭐ 18
Depth controllable Web scraper and Sitemap Generator in Go
total releases 1most recent commit 7 years ago
Sourcegrade ⭐ 18
A web scraper for www.gradesource.com built with MongoDB, Express.js, Node.js, React and Redux
most recent commit 6 years ago
Lambda Web Scraper Example ⭐ 17
An example of a web scraper running on AWS Lambda and Lambda Layers
most recent commit 3 years ago
Crawler ⭐ 17
Web Crawler created with Node.js and Puppeteer
most recent commit 6 years ago
Beer For Python ⭐ 17
[DEPRECATED] A simple web scraper for Beer Advocate
most recent commit 9 years ago
Web_scrapers_ruby ⭐ 16
Samples of Web Scraper using Mechanize, Delayed Job, Parallel, Mongo, etc.
most recent commit 13 years ago
Quickscraper ⭐ 16
An R package wrapping quickscrape, a node.js web scraper
most recent commit 10 years ago
Gumtree Scraper ⭐ 16
Are you looking for an apartment on gumtree.pl? You will like this a lot.
most recent commit 4 years ago
Ankabut ⭐ 16
a web scraper which can find movies ,series ,software ,etc.. direct links and download them
most recent commit a year ago
Twitter_scraper ⭐ 15
Web Scraper for Twitter pages
most recent commit 6 years ago
Tinyback ⭐ 15
A tiny web scraper
most recent commit 11 years ago
Anime Scraper ⭐ 15
[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
most recent commit 5 years ago
Indeed_job_scraper ⭐ 15
💼 Given the Skill and the Location, this script will scrape the Indeed Indian website and present the matching job details.
most recent commit a year ago
Webscrape ⭐ 15
A web scraper to scrape email's and phone numbers from Websites.
most recent commit 2 years ago
Web Scraping Api ⭐ 15
Web Scraping API code examples for Python, PHP and Node.js
most recent commit 7 months ago
Proxi ⭐ 14
Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.
total releases 1most recent commit 4 years ago
Python Scrapfly ⭐ 14
Scrapfly Python SDK for headless browsers and proxy rotation
total releases 33most recent commit 4 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.