Weiquncrawler

This is a crawler for Sina Weiqun website(WAP) information, including given Weiqun's posts, replies, users and their follow relation. Written in Python 2.7.1, store data in SQLite3. Relation-crawling part customized on Github Project sina_reptile.
Alternatives To Weiquncrawler
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Weibo_terminater2,265
4 years ago9Python
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
Tushare283
8 years ago1bsd-3-clausePython
TuShare是实现对股票/期货等金融数据从数据采集、清洗加工 到 数据存储过程的工具,满足金融量化分析师和学习数据分析的人在数据获取方面的需求,它的特点是数据覆盖范围广,接口调用简单,响应快速。
Allnewsspider153
2 years ago4apache-2.0Python
澎湃新闻,新浪新闻,腾讯新闻,搜狐新闻,新闻联播,泰晤士报,纽约时报,BBCNews,旨在爬取所有新闻门户网站的新闻,禁止将所得数据商用!
Weiquncrawler148
10 years agoPython
This is a crawler for Sina Weiqun website(WAP) information, including given Weiqun's posts, replies, users and their follow relation. Written in Python 2.7.1, store data in SQLite3. Relation-crawling part customized on Github Project sina_reptile.
Weibosearch144
11 years agoPython
A distributed Sina Weibo Search spider base on Scrapy and Redis.
Sina Weibo Album Downloader125
8 years ago2apache-2.0Python
Multithreading download all HD photos / pictures from someone's Sina Weibo album.
Weibo Crawler85
4 years ago1mitPython
To crawl Sina Weibo data (text, JPG/GIF images, live photos, and videos). [简单实用] 爬取新浪微博用户所发表或转发的文本、JPG/GIF图片、实况照片和视频。
Sina Weibo Crawler62
5 years ago1gpl-2.0Python
方便扩展的新浪微博爬虫
Crawler Python61
9 years ago4otherPython
a simple crawler framework
Keyword_based_sina_weibo_crawler59
5 years ago4Python
A web crawler for Sina, search and retrieve microblogs that contain certain keywords 一个简单的python爬虫实践,爬取包含关键词的新浪微博
Alternatives To Weiquncrawler
Select To Compare


Alternative Project Comparisons
Popular Sina Projects
Popular Crawler Projects
Popular Companies Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Sqlite
Crawler
Weibo
Sina