Awesome Open Source
Awesome Open Source
Combined Topics
beautifulsoup x

The Top 1,852 Beautifulsoup Open Source Projects

Categories > Text Processing > Beautifulsoup
Requests Html ⭐ 12,324
Pythonic HTML Parsing for Humans™
dependent packages 162total releases 36most recent commit 5 months agopypi requests-html} Downloads
Mechanicalsoup ⭐ 3,962
A Python library for automating interaction with websites.
dependent packages 47total releases 26most recent commit 2 days agopypi MechanicalSoup} Downloads
Ecommercecrawlers ⭐ 3,285
实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼
most recent commit 2 months ago
Soup ⭐ 1,696
Web Scraper in Go, similar to BeautifulSoup
dependent packages 30total releases 10most recent commit 6 months ago
Jobfunnel ⭐ 1,533
Scrape job websites into a single spreadsheet with no duplicates.
most recent commit 6 months ago
Searss ⭐ 1,140
Search to RSS tool
most recent commit 3 years ago
Parliament Scraper ⭐ 1,049
Public Data Scraper for Parliament Data for the EU and other Parliaments
most recent commit 5 years ago
Mnweeklycategory ⭐ 954
码农周刊一周精选分类
most recent commit 2 years ago
Fastcampuswebpythonbasic ⭐ 743
FastCampus 프로그래밍 첫걸음 시작하기 저장소
most recent commit 3 years ago
Easy Scraping Tutorial ⭐ 618
Simple but useful Python web scraping tutorial code.
most recent commit a year ago
Qa Snake ⭐ 562
基于多搜索引擎和深度学习技术的自动问答
most recent commit 3 years ago
Cn_mooc_dl ⭐ 503
中国大学MOOC，学堂在线，网易云课堂，下载
most recent commit 5 years ago
Scrapple ⭐ 452
A framework for creating semi-automatic web content extractors
total releases 10most recent commit 3 years ago
Newsdiffs ⭐ 418
Automatic scraper that tracks changes in news articles over time.
most recent commit 4 years ago
Turkce Python Kaynaklari ⭐ 370
Türkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.
most recent commit 3 months ago
Googlesearchcrawler ⭐ 305
a tool for crawl Google search results
most recent commit 3 years ago
Spidy ⭐ 287
The simple, easy to use command line web crawler.
total releases 12most recent commit 2 months ago
Webpage2html ⭐ 283
save/convert web pages to a standalone editable html file for offline archive/view/edit/play/whatever
total releases 5most recent commit 3 years ago
Jd_seckill ⭐ 278
most recent commit a year ago
Python Automation Scripts ⭐ 264
Simple yet powerful automation stuffs.
most recent commit a year ago
Soupy ⭐ 260
Easier wrangling of web data.
total releases 3most recent commit 4 years ago
Node Soupselect ⭐ 243
Port of Simon Willison's Soup Select (for BeautifulSoup) to node.js and node-htmlparser
dependent packages 14total releases 2most recent commit 4 years agonpm soupselect} Downloads
Jssoup ⭐ 240
JavaScript + BeautifulSoup = JSSoup
dependent packages 24total releases 15most recent commit 9 months agonpm jssoup} Downloads
Pornhub Api ⭐ 236
Unofficial API for PornHub.com in Python
most recent commit 3 months ago
Crawl Zsxq ⭐ 235
爬取知识星球，并制作成 PDF 电子书。
most recent commit 3 years ago
Python3webcrawler ⭐ 234
🌈Python3网络爬虫实战：QQ音乐歌曲、京东商品信息、房天下、破解有道翻译、构建代理池、豆瓣读
most recent commit a month ago
Porndl ⭐ 216
这是一个91porn网站视频下载工具，采用代理（http、socks）模式突破单IP10次访问限制
most recent commit 4 years ago
Djangohunter ⭐ 212
Tool designed to help identify incorrectly configured Django applications that are exposing sensitive information.
most recent commit 4 years ago
Short Jokes Dataset ⭐ 205
Python scripts for building 'Short Jokes' dataset, featured on Kaggle
most recent commit 3 years ago
Web Crawler Tutorial ⭐ 195
Python 網頁爬蟲入門實戰
most recent commit 6 months ago
Cangibrina ⭐ 192
A fast and powerfull dashboard (admin) finder
most recent commit 4 years ago
Videospider ⭐ 178
抓取豆瓣，bilibili等中的电视剧、电影、动漫演员等信息
most recent commit 3 years ago
Trump Lies ⭐ 175
Tutorial: Web scraping in Python with Beautiful Soup
most recent commit 4 years ago
Pythoncrawler ⭐ 175
python3网络爬虫笔记与实战源码。记录python爬虫学习全程笔记、参考资料和常见错误，约40个 pytesseract、PIL等常用库的使用。
most recent commit a year ago
Utools Manuals ⭐ 171
uTools插件，内置了十多个实用的离线中文手册，包括：Linux、PHP、Python、JS等,以
most recent commit a month ago
Weeman ⭐ 163
HTTP Server for phishing in Python
most recent commit 7 years ago
Beautifulsoup ⭐ 163
Beautifulsoup docs in Chinese
most recent commit 2 years ago
Hq_bot ⭐ 161
📲 Bot to help solve HQ trivia
most recent commit 4 years ago
Pynliner ⭐ 159
Python CSS-to-inline-styles conversion tool for HTML using BeautifulSoup and cssutils
most recent commit 3 years ago
Bet On Sibyl ⭐ 157
Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
most recent commit 5 years ago
Web Database Analytics ⭐ 144
Web scrapping and related analytics using Python tools
most recent commit 2 years ago
Customersalsoreviewed Appstore ⭐ 138
“用户也评论了这些应用” -- App Store跨App评论相关性分析脚本
most recent commit 5 years ago
Souqscraper ⭐ 132
Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube
most recent commit a year ago
Google2csv ⭐ 131
Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file
most recent commit 2 years ago
Soupsieve ⭐ 131
A modern CSS selector implementation for BeautifulSoup
dependent packages 325total releases 41most recent commit a month agopypi soupsieve} Downloads
Zhihu Spider ⭐ 128
一个获取知乎用户主页信息的多线程Python爬虫程序。
most recent commit 3 years ago
Sinaspider ⭐ 121
动态IP解决新浪的反爬虫机制，快速抓取内容。
most recent commit 5 years ago
Gsoc Organisation Scraper ⭐ 120
Scrape GSoC organisations using a single script.
most recent commit a year ago
Languagepod101 Scraper ⭐ 106
Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
most recent commit a year ago
Pudzu ⭐ 104
Various python scripts, mostly geared towards dataviz.
total releases 4most recent commit 7 days ago
Programthink ⭐ 102
for 热心读者
most recent commit 4 years ago
Goodork ⭐ 102
Command line go0gle dorking tool
most recent commit 9 years ago
Hive ⭐ 101
lots of spider (很多爬虫）
most recent commit 4 years ago
Scrapekit ⭐ 101
Python library with common functionality for writing web scrapers
total releases 9most recent commit 7 years ago
Euserv_extend ⭐ 101
使用腾讯云函数自动续期EUserv免费IPv6 VPS脚本
most recent commit 9 months ago
Metadata_parser ⭐ 101
python library for getting metadata
total releases 49most recent commit 5 months ago
Webcrawler ⭐ 86
Web crawler to download pictures from zhihu.com
most recent commit 3 years ago
Hq Answer Assist ⭐ 85
百万英雄、冲顶大会等HQ类答题游戏辅助。Android、iOS均支持，推荐答案标红显示。
most recent commit 4 years ago
Html Parsers Benchmark ⭐ 84
Simple HTML DOM parsers benchmark.
most recent commit 7 years ago
Web Scraping ⭐ 76
Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!
most recent commit 4 years ago
Shutterscrape ⭐ 73
Speedy, lightweight web scrapper for Shutterstock.
most recent commit 2 years ago
Linkedin Scraper ⭐ 69
Tool to scrape linkedin
most recent commit 6 months ago
Pelican_plugin Render_math ⭐ 68
A plugin for the pelican blog to allow it render mathematics in Latex.
most recent commit 5 years ago
Data Wrangling With Python ⭐ 66
Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices
most recent commit 8 months ago
Kuaishou Crawler ⭐ 65
As you can see, a kuaishou crawler
most recent commit 2 years ago
Pitchfork ⭐ 65
🎶 Unofficial python API for pitchfork.com reviews.
most recent commit 4 years ago
Facebook Data Analyzer ⭐ 65
📊Python script to analyze the contents of your Facebook data export
most recent commit 3 years ago
Web Scraping ⭐ 65
More than 50 web scraping examples using: Requests | Scrapy | Selenium | LXML | BeautifulSoup
most recent commit a year ago
Pythonpractice ⭐ 63
Python practice works
most recent commit 6 years ago
Ipython Beautifulsoup ⭐ 62
Pretty HTML/XML rendering with syntax highlighting for BeautifulSoup objects in IPython notebook and qtconsole.
total releases 4most recent commit 2 years ago
Novel Crawler ⭐ 62
这是一个用Python写的小说爬虫软件
most recent commit 3 years ago
Soupselect ⭐ 60
CSS selector support for BeautifulSoup.
most recent commit 2 years ago
Cn Mooc Dl ⭐ 60
Script for downloading MOOCs（Refactoring....）
most recent commit 5 years ago
Duden ⭐ 60
CLI for http://duden.de dictionary written in Python
total releases 15most recent commit 9 months ago
Intro Data Journalism With Python ⭐ 60
Code for the "Intro to Data Journalism with Python" Workshop
most recent commit 9 years ago
Linuxacademy Dl ⭐ 57
Download videos from your LinuxAcademy account for offline viewing
most recent commit a year ago
Supremedropbot ⭐ 57
A supreme web bot, written in python, to grab a list of specified products, and checkout before they sell out!
most recent commit 3 years ago
Vidscraper ⭐ 57
Vidscraper is a python library which provides a simple API for fetching video data from various web services and sites.
dependent packages 1total releases 7most recent commit 3 years agopypi vidscraper} Downloads
Zsxq Spider ⭐ 57
爬取知识星球内容，并制作 PDF 电子书。
most recent commit 2 years ago
Tiktok Downloader ⭐ 55
Tiktok Downloader/Scraper using requests & bs4
most recent commit 3 months ago
Euro2016_terminalapp ⭐ 55
⚽️ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!
most recent commit 5 years ago
Gsocanalyzer ⭐ 53
A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.
most recent commit 6 months ago
Anipy Cli ⭐ 52
Little tool in python to watch and download anime from the terminal (the better way to watch anime). Also applicable as API
total releases 30most recent commit 4 days ago
Html Table Extractor ⭐ 51
extract data from html table
total releases 8most recent commit 2 years ago
All It Ebooks Spider ⭐ 51
[Updated] A simple python crawler for my tutorial blog at http://www.jianshu.com/p/8fb5bc33c78e
most recent commit 5 years ago
Whatsoup ⭐ 50
A web scraper that exports your entire WhatsApp chat history.
most recent commit a year ago
Beautifulgirls ⭐ 50
爬虫+脸部识别+DCGAN脸部自动生成
most recent commit 5 years ago
Hnscrapy ⭐ 50
Hacker News Crawler based upon Scrapy.
most recent commit 9 years ago
Scraplat ⭐ 50
I'm trying to finish the scraplat as a scraper platform
most recent commit 6 years ago
Newspaper3_usage_overview ⭐ 49
This repository provides usage examples for the Python module Newspaper3k.
most recent commit 10 months ago
News At Command Line ⭐ 48
📰 News at the command line
most recent commit 10 months ago
5ch Analysis ⭐ 48
5chの過去ログをスクレイピングして、過去流行った単語(ex, 香具師, orz)などを追跡調査
most recent commit 4 years ago
Csdn_downloader ⭐ 48
use the website(http://www.juming.com/Csdn/) to free downloader file from CSDN, just package to a pyQt application.
most recent commit 5 years ago
Configuration Profile Reference ⭐ 48
Version controlled mirror in markdown for Apple's Configuration Profile Reference
most recent commit 3 years ago
Py Gameday ⭐ 47
Python scripts to pull down MLB Gameday files into a database
most recent commit 2 years ago
Bookingscraper ⭐ 47
🌎 🏨 Scrape Booking.com 🏨 🌎
most recent commit 2 years ago
Ptt_beauty_spider ⭐ 47
PTT 表特版爬蟲圖片下載器
most recent commit 4 years ago
Python Maoyan Spider ⭐ 46
🌈 攻陷猫眼网数据反爬（一次爬与反爬的斗智斗勇）
most recent commit 3 years ago
Sligen ⭐ 45
Pitching like a boss
most recent commit 7 years ago
Robox ⭐ 44
Simple library for exploring/scraping the web or testing a website you’re developing
total releases 5most recent commit 4 months ago
1-100 of 1,852 projects
Related Awesome Lists
Python Beautifulsoup Projects (1,539)
Scraping Beautifulsoup Projects (259)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,060,849)
Python  (808,237)
Java  (388,770)
Php  (286,112)
Typescript  (247,064)
C Plus Plus  (239,040)
Ruby  (221,847)
C  (182,165)
Shell  (171,385)
C Sharp  (164,315)
Golang  (158,443)
Swift  (65,269)
R  (57,993)
Rust  (57,713)
Objective C  (57,185)
Dart  (52,750)
Kotlin  (46,539)
Lua  (33,954)
Matlab  (31,189)
Perl  (30,541)
Language  (30,056)
Scala  (28,676)
Haskell  (20,380)
Clojure  (19,146)
Powershell  (19,044)
Bash  (18,688)
Coffeescript  (17,289)
Elixir  (16,660)
Assembly  (14,698)
Processing  (13,307)
Julia  (12,765)
Basic  (10,736)
Flow  (10,548)
Emacs Lisp  (10,420)
Erlang  (9,063)
Groovy  (8,449)
Scheme  (8,439)
Solidity  (7,998)
Ocaml  (6,712)
Pascal  (6,443)
Hack  (6,397)
Lisp  (6,343)
Fortran  (5,547)
Elm  (5,484)
Common Lisp  (5,302)
Dlang  (4,745)
Shell Script  (4,656)
Python Library  (4,458)
Crystal  (4,387)
Scripting  (4,208)
Top Projects
Freecodecamp ⭐ 348,433
996.icu ⭐ 262,763
Free Programming Books ⭐ 238,208
Coding Interview University ⭐ 223,024
Awesome ⭐ 206,565
Developer Roadmap ⭐ 199,094
Public Apis ⭐ 198,920
Vue ⭐ 197,406
React ⭐ 190,794
System Design Primer ⭐ 184,236
Tensorflow ⭐ 166,164
Bootstrap ⭐ 158,303
You Dont Know Js ⭐ 153,649
Cs Notes ⭐ 151,618
Ohmyzsh ⭐ 147,075
Build Your Own X ⭐ 146,712
Javascript Algorithms ⭐ 144,783
Flutter ⭐ 142,356
Python ⭐ 139,465
Gitignore ⭐ 134,790
Linux ⭐ 134,105
Vscode ⭐ 133,588
Awesome Python ⭐ 132,320
Javascript ⭐ 124,360
Javaguide ⭐ 124,154
Python 100 Days ⭐ 120,315
Computer Science ⭐ 118,096
Youtube Dl ⭐ 111,218
Fucking Algorithm ⭐ 107,431
The Art Of Command Line ⭐ 106,741
React Native ⭐ 103,597
Electron ⭐ 102,371
D3 ⭐ 101,796
Go ⭐ 101,252
30 Seconds Of Code ⭐ 96,728
Create React App ⭐ 95,778
Axios ⭐ 94,331
Free Programming Books Zh_cn ⭐ 93,999
Awesome Selfhosted ⭐ 93,372
Kubernetes ⭐ 89,861
Next.js ⭐ 89,059
Node ⭐ 88,550
Terminal ⭐ 83,818
Deno ⭐ 83,639
Awesome Go ⭐ 83,320
Three.js ⭐ 83,317
Angular ⭐ 82,456
Typescript ⭐ 81,954
Ant Design ⭐ 80,934
Material Ui ⭐ 79,467
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.