Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for selenium web crawler
selenium
x
web-crawler
x
11 search results found
Spider Flow
⭐
8,075
新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Helium
⭐
4,113
Lighter web automation for Python
Automatic Udemy Course Enroller Get Paid Udemy Courses For Free
⭐
3,010
Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!
30 Days Of Python
⭐
1,926
Learn Python for the next 30 (or so) Days.
Rpa
⭐
858
UI.Vision: Open-Source RPA Software (formerly Kantu) - Modern Robotic Process Automation with Selenium IDE++
Wereadscan
⭐
447
扫描“微信读书”已购图书并下载本地PDF的爬虫
Dude
⭐
397
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
Tarsier
⭐
372
Vision utilities for web interaction agents 👀
Scrape Linkedin Selenium
⭐
353
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Uscrapper
⭐
298
Uscrapper 2.0, a powerful OSINT webscraper for personal data collection. Uscrapper uses web scraping to extract email IDs, social-media links, geolocations, phone numbers, and usernames from webpages, supports multithreading, has advanced Anti-webscraping bypassing modules, supports webcrawling to scrape from various sublinks within the same domain
Web Scraping
⭐
281
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
Easyapplyjobsbot
⭐
247
A python bot to automatically apply all Linkedin,Glassdoor, etc Easy Apply jobs based on your preferences. Auto login, auto fill additional questions, apply automatically!
Twitter Scraper Selenium
⭐
207
Python's package to scrap Twitter's front-end easily
Bet On Sibyl
⭐
157
Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
Facebook_page_scraper
⭐
150
Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV
Scrape Up
⭐
148
A web-scraping-based python package that enables you to scrape data from various platforms like GitHub, Twitter, Instagram, or any useful website.
Zillow
⭐
129
Zillow Scraper for Python using Selenium
Educative.io_scraper
⭐
117
Educative.io Course Downloader developed using Python and Selenium. Refer Readme.md for setup instructions.
Seleniumcrawler
⭐
105
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Senpwai
⭐
97
A desktop app for tracking and batch downloading anime
Wswp
⭐
95
Code for the second edition Web Scraping with Python book by Packt Publications
Splashr
⭐
88
💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R
Webcrawler
⭐
86
Web crawler to download pictures from zhihu.com
Webscrapper
⭐
77
Simple and powerfull all in one Telegram Bot to scrap webpages using Requests, html5lib and Beautifulsoup
Instagram Scraper 2021
⭐
77
Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Goodreadsscraper
⭐
76
Scrape data from Goodreads using Scrapy and Selenium 📚
Autoscrape Py
⭐
70
An automated, programming-free web scraper for interactive sites
Schweizermesser
⭐
66
🎯Python 3 网络爬虫实战、数据分析合集 | 当当 | 网易云音乐 | unsplash | 必胜客 | 猫眼 |
Instagram Giveaways Winner
⭐
59
Instagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!
Scraping Tripadvisor With Python 2020
⭐
58
Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website
Linkedin Profiles Scraping
⭐
51
Automatically scrape the web data of people profiles on Linkedin based on a specific search query
Instagram Bot
⭐
48
🤖 Python bot to view stories, like and comment on Instagram
Trscraper
⭐
47
TRScraper, doğal dil işleme uygulamalarında kullanılmak amacıyla geliştirilmiş, Türkçe içerik girilen büyük platformlarda metin madenciliği yapma imkanı sunan bir uygulamadır.
Twitterbot
⭐
45
🤖 CLI Twitter Bot. It's made to reach more engagement based on your interests.
Scalpel
⭐
38
A fast and powerful web scraping library
Linkedin Comments Scraper
⭐
36
Script to scrape comments (including name, profile link, pfp, designation, email(if present), and comment) from a LinkedIn post from the URL of the post.
Supercharged Web Scraping With Asyncio
⭐
31
Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).
Gcf Packs
⭐
30
Library packs for google cloud functions
Goodreadsscraper
⭐
30
📚 A GoodReads.com Scraper script to get books reviews including text and rating.
Python Data From Web
⭐
29
API and web scraping workshops
Non Api Fb Scraper
⭐
29
Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Botcity Framework Web Python
⭐
28
BotCity Framework Web - Python
Linkedin Web Scraper
⭐
28
Python Web Scraper for LinkedIn to collect and store company data (e.g. name, description, industry, etc.) into .xls file
Wawebsessionhandler
⭐
27
(DISCONTINUED) Save WhatsApp Web Sessions as files and open them everywhere!
Selenium Grid Docker Swarm
⭐
27
web scraping in parallel with Selenium Grid and Docker
Charles
⭐
25
Java web crawling library
Veri_cekme
⭐
24
Beautifulsoup and Selenium
Scraping Youtube Comments
⭐
22
Scrape comments from any Youtube video
Webscraping Selenium
⭐
22
webscraping using selenium python
Streamlit Selenium
⭐
21
Streamlit project to test Selenium running on Streamlit Cloud
Mexican Jobs 2020
⭐
20
Data ETL & Analysis on thousands of job listings from the official Mexican job board (2020 edition).
Scrapevin
⭐
19
A python package for scraping vinted - all foreign versions aswell!
Words Scraper
⭐
19
Selenium based web scraper to generate passwords list
Chesf
⭐
19
CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
Amazon Product Scraping
⭐
18
Web scraping amazon products based on user search using Selenium Webdriver.
Bsctokenscanner
⭐
16
Pulls Binance Smart Chain feed of newly-verified contracts every 30 seconds, then checks their contract code for links to socials.Returns only those with socials information included, and then submits the contract address to TokenSniffer to evaluate contract legitimacy
Web Scraping Python
⭐
15
It contains some web scraping examples implemented using Python.
Selenium_python
⭐
15
Twitter_scraper
⭐
15
Web Scraper for Twitter pages
Stock Fundamental Data Scraping And Analysis
⭐
14
Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go
Image Crawler
⭐
14
An image scraper that scraps images from unsplash.com
Crawler_pubg.op.gg
⭐
13
This is a web crawler for pubg.op.gg, written by Ruichong Liu. 绝地求生游戏数据抓取
Udemyscraper
⭐
13
A Udemy Course Scraper built with bs4 and selenium, that fetches udemy course information. Get udemy course information and convert it to json, csv or xml file, without authentication!
Webscraping
⭐
12
Web Scraping and Data Analysis with Selenium and Python
Schedule Tweet
⭐
12
Schedules tweets using TweetDeck
Fbrowser
⭐
12
Helpful Selenium functions to make web-scraping easier and faster
Chatgpt Autochat
⭐
11
This repository contains code that automates chat interactions with ChatGPT using Selenium and ChromeDriver. ChatGPT is a large language model that can engage in conversations and provide responses to user inputs. With this code, you can have automated and interactive chats with ChatGPT right from your Python environment.
Fk Review Scraper
⭐
11
Python script for scraping product reviews
Facebook_events_scraper
⭐
11
Scrape Facebook page events(recurring and upcoming), and individual event on new Facebook design
Selenium_facebook_scraper
⭐
10
A simple python3 script used to download a users's friend list from facebook.
Metu Nte Scraper
⭐
9
Web_scraping_nba_data
⭐
9
Using Selenium to web scrape Basketball-Reference.com
Olx Web Scraper
⭐
9
Use python to scrap for listings on olx.in based on search query.
Yc Scraper
⭐
9
✌️Y Combinator directory scraper
India Trade Data
⭐
9
A web scraper written in Python to gather trade data for India across commodities and countries
Teanaps Web Scraper
⭐
8
텍스트 분석용 데이터 수집을 위한 웹스크래핑 도구를 제공합니다.
Glassdoor Application Filler
⭐
8
This is a script to fill out job applications by themselves with your information
Sd Webui Automation
⭐
8
Stable Diffusion web UI Automation
Bet365_web_scraping
⭐
8
Ainda tem como raspar dados do site bet365.com - tutorial educacional (SeleniumBase / ADB) - 2023
Rgpv Exam Result Analysis And Prediction
⭐
8
The project would generate report of the result of the students and is also capable of concluding the result analysis report of the students as in tables, figures in Excel Sheet. The project is based on python which will use the web scraping technique used to launch the website from an automated software (as a web browser) to visit the website (RGPV) and fetch data as results of an individual student, Data analysis which is used to inspecting, cleansing, transforming and modeling data with the g
Codechef_automation_bot
⭐
8
This is a bot used for downloading the test cases from CodeChef contests, Testing our code against given test cases, and submitting our code to the online judge all done in the command line.
Dataanalysis_bootcamp_crawler
⭐
8
Web scraper implementations for a variety of websites.
Botasaurus Starter
⭐
7
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Webscrapping Poetryfoundation
⭐
7
Extracting all the poems from Poetry Foundation, using Selenium, ,Beautiful Soup and Multiprocessing
Blackboard Auto
⭐
7
A python based application that automatically logs in into your accounts and attends your classes on cuchd.blackboard.com website.
Findslots 42
⭐
7
Personal project. Find correction slots across the 42 network, using selenium in python for webscraping, and be notified.
Spoj_ptit_crawler
⭐
7
Zlib Dl
⭐
7
Python tool allowing easy book downloads from the terminal
Amazon Product Information Scraper
⭐
7
This Python web-scraping project retrieves product names, prices, review stars, and review counts for a specific product category.
Automatic Notion Backup
⭐
7
This script automates the backup process of Notion data into Markdown and CSV formats. Additionally, the script processes the data to remove any AWS identifiers that may be present in the Markdown files, folders, and internal references to other files in the backup
Webscraping Py
⭐
6
Web Scraping scripts for all Google, other search engines, and other websites (currently outdated, something may not be working).
Custom Web Scrappers
⭐
6
Custom web scraping scripts i have built related to extracting data from sites like Instagram and Weather-Underground.
Webscraping Instagram
⭐
6
⭐ Automated jobs on instagram using webscraping!
Ucsd_webscraper
⭐
6
A project to automate the class enrollment process of UCSD's WebReg.
Stalker Insta
⭐
6
An Instagram crawler for fetching a profile.
Scrapy Projects
⭐
6
Projects using selenium, requests, bs4, and scrapy for web scraping on google images, google trends and others
Web Scraping Examples
⭐
6
This repo aims to provide a straightforward, easy-to-use scraping code written in Python.
Internshipautomation
⭐
6
Python scripts to automate the tasks
Wpp Data Monitor
⭐
6
Whatsapp data monitor.
Legiscrawler
⭐
6
An automation webcrawler based on Selenium library for retrieving parliamentary questions on The Website of Taiwan Legislative Yuan (https://lis.ly.gov.tw/). 🕸️ 🕸️ 爬立法委員問政專輯的爬蟲小幫手 🛠️🧰
Related Searches
Python Selenium (3,627)
Testing Selenium (2,075)
Selenium Webdriver (1,510)
Java Selenium (1,500)
Scraper Web Crawler (1,388)
Javascript Selenium (1,264)
1-11 of 11 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.