Awesome Open Source
Awesome Open Source

Web scraping, database and related analytics

GitHub issues GitHub forks GitHub stars PRs Welcome Github commits

Dr. Tirthajyoti Sarkar (You can connect with me on LinkedIn)


  • Python 3.5+
  • NumPy ($ pip install numpy)
  • Pandas ($ pip install pandas)
  • requests ($ pip install requests)
  • BeautifulSoup4 ($ pip install beautifulsoup4)
  • MatplotLib ($ pip install matplotlib)

My new book on Data wrangling with Python


What type of Notebooks are here?

How to design your own mini-IMDB movie database by scraping web?

Check out this article I wrote on Medium about this topic

How to scrape data from CIA website (this is harmless, I promise) about simple facts on various nations?

Check out this article I wrote on Medium about this topic

How to build a Yelp crawler which can generate interesting word cloud based on a particular city's food cuisine and taste?

How to crawl the Project Gutenberg portal and download 100 most popular books automatically?

How to use a free API to download basic information about countries around the world and build a database?

Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
python (47,791
jupyter-notebook (5,354
database (1,113
json (1,072
nlp (942
data-science (765
sql (628
natural-language-processing (608
analytics (283
sqlite3 (91
regular-expression (69
json-parser (59
web-scraping (59
xml-parser (32
data-wrangling (21
beautifulsoup4 (14

Find Open Source By Browsing 7,000 Topics Across 59 Categories