Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Automation Scraper Open Source Projects

Open source projects categorized as Automation Scraper
Huginn ⭐ 41,465
Create agents that monitor and act on your behalf. Your agents are standing by!
dependent packages 52total releases 8most recent commit 18 days agorubygems huginn_agent} Downloads
Crawlee ⭐ 12,106
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
dependent packages 42total releases 747most recent commit 3 days agonpm crawlee} Downloads
Undetected Chromedriver ⭐ 7,232
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
dependent packages 100total releases 53most recent commit 3 months agopypi undetected-chromedriver} Downloads
Autoscraper ⭐ 5,159
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
dependent packages 1total releases 16most recent commit a year agopypi autoscraper} Downloads
Rod ⭐ 4,505
A Devtools driver for web automation and scraping
dependent packages 140total releases 406most recent commit 3 months ago
Browser Fingerprinting ⭐ 3,353
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?
most recent commit a year ago
Awesome Puppeteer ⭐ 2,245
A curated list of awesome puppeteer resources.
most recent commit 4 months ago
Oj ⭐ 956
Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.
dependent packages 9total releases 109most recent commit 2 months agopypi online-judge-tools} Downloads
Bot ⭐ 790
Completely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
total releases 78most recent commit 3 months ago
Episode Rename ⭐ 699
电视剧/番剧自动化重命名工具, 一键批量改名. 可配合QBittorrent下载后自动重命名, 方便Emby自动刮削. 支持Windows, Linux, MacOS, Docker 和 群晖套件环境运行
most recent commit 4 months ago
Linvo Scraper ⭐ 553
Linkedin Automation Bot with every possible scraping! Valid for 2022 used by Linvo.io
dependent packages 2total releases 6most recent commit 8 months agonpm linvo-scraper} Downloads
Comic Dl ⭐ 498
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
total releases 10most recent commit 8 months ago
Nickjs ⭐ 488
Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
dependent packages 2total releases 31most recent commit 4 years agonpm nickjs} Downloads
Tinderbotz ⭐ 468
Automated Tinder bot and scraper using selenium in python.
total releases 8most recent commit 3 months ago
Python Automation Scripts ⭐ 264
Simple yet powerful automation stuffs.
most recent commit 3 years ago
Anime Dl ⭐ 196
Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
most recent commit 3 years ago
Ayakashi ⭐ 177
⚡ Ayakashi.io - The next generation web scraping framework
dependent packages 2total releases 40most recent commit 10 months agonpm ayakashi} Downloads
Helena ⭐ 165
A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.
most recent commit 3 years ago
Auto Gmail Creator ⭐ 158
Open Source Bulk Auto Gmail Creator Bot with Selenium & Seleniumwire ( Python ). Feel free to contact me with Django/Flask, ML, AI, GPT, Automation, Scraping.
most recent commit 6 months ago
Grawler ⭐ 128
Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.
most recent commit 3 years ago
Apify Sdk Python ⭐ 101
The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.
total releases 113most recent commit 3 months ago
Yt Videos List ⭐ 100
Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.
dependent packages 1total releases 1most recent commit 5 months agonpm yt-videos-list} Downloads
Python Selenium Action ⭐ 93
Run Selenium with Python via Github Actions using Headless or Non-Headless browsers!
most recent commit a year ago
The 10 Most Depended On Automation Scraper Open Source Projects
Rod ⭐ 4,505
A Devtools driver for web automation and scraping
dependent packages 140total releases 406latest release November 06, 2023most recent commit 3 months ago
Huginn ⭐ 41,465
Create agents that monitor and act on your behalf. Your agents are standing by!
dependent packages 52total releases 8latest release September 22, 2017most recent commit 18 days agorubygems huginn_agent} Downloads
Oj ⭐ 956
Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.
dependent packages 9total releases 109latest release September 13, 2021most recent commit 2 months agopypi online-judge-tools} Downloads
Api Client ⭐ 39
API client to develop tools for competitive programming
dependent packages 5total releases 32latest release August 22, 2021most recent commit 2 years agopypi online-judge-api-client} Downloads
Browse ⭐ 8
browse is a declerative programming language for web scraping, automation and UI testing
dependent packages 5total releases 20latest release September 18, 2020most recent commit 4 years agonpm @browselang/parser} Downloads
Fbjs ⭐ 53
Tooling that automates your Facebook interactions.
dependent packages 2total releases 11latest release July 09, 2021most recent commit a year agonpm @makepad/fbjs} Downloads
Local Api Client Typescript ⭐ 54
Official JavaScript/TypeScript library for interacting with Kameleo Client
dependent packages 2total releases 11latest release July 20, 2023most recent commit 9 months agonpm @kameleo/local-api-client} Downloads
The 10 Latest Releases In Automation Scraper Open Source Projects
Rod ⭐ 4,505
A Devtools driver for web automation and scraping
dependent packages 140total releases 406latest release November 06, 2023most recent commit 3 months ago
Local Api Client Python ⭐ 53
Official Python library for interacting with Kameleo Client
total releases 9latest release July 21, 2023most recent commit 9 months ago
Local Api Client Typescript ⭐ 54
Official JavaScript/TypeScript library for interacting with Kameleo Client
dependent packages 2total releases 11latest release July 20, 2023most recent commit 9 months agonpm @kameleo/local-api-client} Downloads
Ayakashi ⭐ 177
:zap: Ayakashi.io - The next generation web scraping framework
dependent packages 2total releases 40latest release June 29, 2023most recent commit 10 months agonpm ayakashi} Downloads
Autopahe ⭐ 5
Automatically download your all favorite anime from AnimePahe
total releases 11latest release June 19, 2023most recent commit 10 months ago
Popular Artificial Intelligence Categories
Artificial Intelligence
Robot
Ros
Discord Bot
Home Assistant
Telegram Bot
Chatbot
Robotics
Object Detection
Home Automation
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.