Awesome Open Source
Awesome Open Source
Combined Topics
beautifulsoup x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 781 Beautifulsoup Open Source Projects on Github

Categories > Text Processing > Beautifulsoup
Requests Html ⭐ 12,044
Pythonic HTML Parsing for Humans™
Mechanicalsoup ⭐ 3,769
A Python library for automating interaction with websites.
Jobfunnel ⭐ 1,509
Scrape job websites into a single spreadsheet with no duplicates.
Soup ⭐ 1,322
Web Scraper in Go, similar to BeautifulSoup
Easy Scraping Tutorial ⭐ 618
Simple but useful Python web scraping tutorial code.
Scrapple ⭐ 452
A framework for creating semi-automatic web content extractors
Turkce Python Kaynaklari ⭐ 327
Türkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.
Python Automation Scripts ⭐ 264
Simple yet powerful automation stuffs.
Djangohunter ⭐ 212
Tool designed to help identify incorrectly configured Django applications that are exposing sensitive information.
Jssoup ⭐ 208
JavaScript + BeautifulSoup = JSSoup
Short Jokes Dataset ⭐ 205
Python scripts for building 'Short Jokes' dataset, featured on Kaggle
Pornhub Api ⭐ 193
Unofficial API for PornHub.com in Python
Trump Lies ⭐ 175
Tutorial: Web scraping in Python with Beautiful Soup
Bet On Sibyl ⭐ 157
Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
Souqscraper ⭐ 132
Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube
Gsoc Organisation Scraper ⭐ 120
Scrape GSoC organisations using a single script.
Soupsieve ⭐ 109
A modern CSS selector implementation for BeautifulSoup
Languagepod101 Scraper ⭐ 106
Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Pudzu ⭐ 105
Various python scripts, mostly geared towards dataviz.
Hive ⭐ 101
lots of spider (很多爬虫）
Web Scraping ⭐ 76
Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!
Shutterscrape ⭐ 73
Speedy, lightweight web scrapper for Shutterstock.
Pitchfork ⭐ 65
🎶 Unofficial python API for pitchfork.com reviews.
Web Scraping ⭐ 65
More than 50 web scraping examples using: Requests | Scrapy | Selenium | LXML | BeautifulSoup
Facebook Data Analyzer ⭐ 65
📊Python script to analyze the contents of your Facebook data export
Novel Crawler ⭐ 62
这是一个用Python写的小说爬虫软件
Supremedropbot ⭐ 57
A supreme web bot, written in python, to grab a list of specified products, and checkout before they sell out!
Euro2016_terminalapp ⭐ 55
⚽️ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!
Html Table Extractor ⭐ 51
extract data from html table
Whatsoup ⭐ 50
A web scraper that exports your entire WhatsApp chat history.
Newspaper3_usage_overview ⭐ 49
This repository provides usage examples for the Python module Newspaper3k.
Linkedin Scraper ⭐ 49
Tool to scrape linkedin
News At Command Line ⭐ 48
📰 News at the command line
Bookingscraper ⭐ 47
🌎 🏨 Scrape Booking.com 🏨 🌎
Ptt_beauty_spider ⭐ 47
PTT 表特版爬蟲圖片下載器
Awsomespider ⭐ 42
Python爬虫小项目汇总（招聘信息/电影信息/股票信息/天气信息/贴吧信息/图片信息/视频信息..）
Track Stargazers ⭐ 38
Have fun tracking your project's stargazers
Beautifulscraper ⭐ 37
Python web-scraping library that wraps urllib2 and BeautifulSoup
Webcrawlingstudy ⭐ 35
초보자들을 위한 웹크롤링 온라인 강의
Lostark Wait Notifier ⭐ 35
🐤️ Lost Ark wait notifier
Greek Wines Analysis ⭐ 34
Scraper, Data and Analysis for "Analyzing 1000+ Greek Wines with Python"
Zhilian_spider ⭐ 33
智联招聘关键词搜索职位信息爬虫
Wikipedia Reference Scraper ⭐ 31
Wikipedia API wrapper for references
Ali Scraper ⭐ 30
A scraper which scraps Ali Express
Goodreadsscraper ⭐ 30
📚 A GoodReads.com Scraper script to get books reviews including text and rating.
Non Api Fb Scraper ⭐ 29
Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Universityrecruitment Ssurvey ⭐ 28
用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？
Gsocanalyzer ⭐ 28
Grailer ⭐ 28
web scraping tool for grailed.com
Grab_beautiful_girls_pictures ⭐ 28
抓取MM131美女写真图片，并将其保存至本地指定的文件夹中。
Inshorts Api ⭐ 27
An Inshorts API which provides news for different categories from the Inshorts Website. Built using Flask and Beautiful Soup.
Email Report ⭐ 27
A modular template for scraping data from the web to send yourself scheduled email reports
Comicbookmaker ⭐ 26
Script to fetch webcomics and use them to create ebooks.
Pythonspider ⭐ 26
🕷some python spiders with BeautifulSoup or scarpy
Beautifulsoup Tutorial ⭐ 26
✨ 🍜 Scrape webpage metadata using BeautifulSoup.
Tieba Birthday Spider ⭐ 26
百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福
Ds Ml Public ⭐ 25
Python Scripts and Jupyter Notebooks
Wechat_articles_spider ⭐ 25
A Spider About Wechat Articles 、Official Accounts
Atlas Obscura Api ⭐ 23
A simple flask api for Atlas Obscura.
Selenabot ⭐ 22
A python instagram scraper which uses BeautifulSoup and JSON to scrape public instagram accounts
Pixelarity Download ⭐ 21
Automatically download Pixelarity templates ⭐️
Househunterbot ⭐ 21
Use Python, Google Spreadsheet, Google Shortener and CALLR API to automate your apartment search in Paris.
Scrapy Picture Spider ⭐ 21
The project is a spider that uses scrapy and beautifulsoup4 for crawl picture.
Web_scraping_python ⭐ 20
Techniques for Scraping the Web in Python
Anyme Dl ⭐ 19
Download complete anime episodes
Fabulous ⭐ 19
Fabulous Bot for Slack!
Weibocar ⭐ 19
【爬虫】基于Scrapy开发的微博（评论、转发、点赞）爬虫，可以批量抓取。
Chopper ⭐ 19
Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules
Torscrapper ⭐ 19
A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Facebook Web Scraper ⭐ 18
A collection of tools that you can use to collect data from Facebook
Sjs_drops ⭐ 18
Script using requests module to register accounts to Slam Jam Socialism raffles.
Create_word_cloud ⭐ 18
create word clouds with wrodcloud-fa for twitter and telegram chat
Tibia.py ⭐ 17
API to parse tibia.com content into python objects.
Data Wrangling With Python ⭐ 16
Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices
Web Scraping With Python ⭐ 15
In this repository i will expalin how to scrap websites using python programming language with BeautifulSoup and requestsmodulues
Raplyrics Scraper ⭐ 15
Data sourcing and pre-processing for raplyrics.eu - A rap music lyrics generation project
Society Email Scrape ⭐ 15
Scrapes Every Email Address of Every Society in Every University
Scraper Projects ⭐ 14
🕸 List of mini projects that involve web scraping 🕸
Linkedinbot ⭐ 14
Automate the process of sending referral request and cold mailing on LinkedIn
Sig To Googlecalendar ⭐ 14
A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar
Kick Off Web Scraping Python Selenium Beautifulsoup ⭐ 13
A tutorial-based introduction to web scraping with Python.
Beautifulsoup.dart ⭐ 13
A dart port of the famous python library beautifulsoup
Music Library Ocd Fixer ⭐ 13
Automatically fetch metadata for your music collection and rename files accordingly
Pacpaw ⭐ 13
Pawn package manager for SA-MP
Nyu Info 2335 201706 ⭐ 13
Programming in Python and Fundamentals of Software Development - Summer 2017
Okanimedownloader ⭐ 12
Scrape your favorite Anime from Okanime.com without effort
Mediumscraper ⭐ 12
Scraping articles of medium and providing audio versions 📑 to 🔊 using django
Indeed_scrapper ⭐ 12
Scrapper and Parser for Indeed Jobs and Resumes using Python, BeautifulSoup and Selenium/Requests and storing and manipulating data using mongodb
Twitter Bot Selenium ⭐ 12
Twitter-Bot-Selenium simulates the entry of a real person and perform the actions of Like, ReTweet, Follow and UnFollow using different keywords.
Web Scrapers ⭐ 12
various web scrapers as examples
Book_scraper_python ⭐ 12
A demo to use the BeautifulSoup Python package to get the book informations from websites
Sofpythonbot ⭐ 11
This Telegram-Bot answers python questions by using stackoverflow subjects.
Scrape Amazon ⭐ 11
🤩 Python Package for Scraping Amazon Product Reviews ✨
Fk Review Scraper ⭐ 11
Python script for scraping product reviews
Lyricaly ⭐ 11
🎵 Lyricaly gets Lyrics delivered to your Terminal for any Song. Uses Python beautifulsoup4 to scrap lyrics. pypi: lyricaly
Web Link Tester ⭐ 11
Flask App to scrape hrefs from websites and validate links
Amazon Price Tracker Python ⭐ 10
Amazon price tracker Python app that regularly compares the price of your favourite product on Amazon and sends you a customized notification mail informing you about the fallen price
Indeed Python Wrapper ⭐ 10
A Python wrapper for Indeed Job Search API
Python Scraper Tutorial ⭐ 10
Short introduction to scraping with given steps an example of a scraper
Tweet Transcriber ⭐ 10
A Reddit bot that transcribes tweets from comments and submissions links, mirrors their images and replies back with a formatted Markdown message.
1-100 of 781 projects

Related Projects

Python Beautifulsoup Projects (695)
Webscraping Beautifulsoup Projects (221)
Python3 Beautifulsoup Projects (195)
Python Webscraping Beautifulsoup Projects (192)
Python Python3 Beautifulsoup Projects (165)
Requests Beautifulsoup Projects (142)
Python Requests Beautifulsoup Projects (132)
Jupyter Notebook Beautifulsoup Projects (114)
Selenium Beautifulsoup Projects (100)
Python Selenium Beautifulsoup Projects (93)
Scraper Beautifulsoup Projects (89)
Python Scraper Beautifulsoup Projects (85)
Beautifulsoup Beautifulsoup4 Projects (80)
Python Beautifulsoup Beautifulsoup4 Projects (74)
Html Beautifulsoup Projects (66)
Scraping Beautifulsoup Projects (66)
Flask Beautifulsoup Projects (66)
Python Jupyter Notebook Beautifulsoup Projects (66)
Python3 Webscraping Beautifulsoup Projects (66)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021