Weibospider
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Weibospider | 4,786 | 3 years ago | 9 | mit | Python | |||||
| :zap: A distributed crawler for weibo, building with celery and requests. | ||||||||||
| Covid Social Analysis | 29 | 2 months ago | HTML | |||||||
| ML-based analysis of social media users' attentiveness under the COVID-19. Data crawling, analysis, visualization. || 疫情背景下分阶段的微博文本情感分析与可视化 | ||||||||||
| Weibo_data_analysis | 19 | 5 years ago | cc-by-sa-4.0 | Python | ||||||
| :notebook: Some simple visualization and analysis of weibo user data using graph_tools. | ||||||||||
| Alipythondataanalysis | 3 | 3 years ago | Python | |||||||
| 网络爬虫、selenium自动化、数据处理、数据分析、机器学习算法 | ||||||||||
| Hot_weibo | 1 | 5 years ago | Python | |||||||
| This repository is about weibos' prediction | ||||||||||
⭐️
-
-
PC**
domain``domain -
-
wiki**** issue
2.release
3.cd
4.source env.shPythonpip3 install -r requirements.txt
5.spider.ymlMySQLRedis
6.weibo``python config/create_all.pyv1.7.2python create_all.py
7.(**v1.7.3)Web UIadmin/weibo_admin/settings.pyDATABSES
python admin/manage.py makemigrations
python admin/manage.py migrate
python admin/manage.py createsuperuser
django admin``python admin/manage.py createsuperuserdjangotest``[email protected]``weibospider2017
8.seed_ids``uid``uid**oid``keywords7Web UI
python admin/manage.py runserver 0.0.0.0:8000
http://127.0.0.1:8000/admin``test``weibospider2017djangoweb server**
gunicornuwsgiweb server,supervisor
celery -A tasks.workers -Q login_queue,user_crawler,fans_followers,search_crawler,home_crawler worker -l info -c 1
worker-Qweibospider-c``-l
source env.sh``pip3 install -r requirements.txt
10.worker1python first_task_execution/login_first.py2Cookie24****
celery beat -A tasks.workers -l info
celery beaterCelery Workerbeatertasks/workers.py
👍
**
📢
❗️
❤️
- Askcelerykennethreitzrequests
-
starissue
