Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for scraping websites
scraping-websites
x
167 search results found
Youtube Indexer
⭐
11
Index YouTube creator videos and detect changes like removals or video duration changes. Requires no API key
Competitive Coding Problem Classifier And Recommender
⭐
11
Competitive Coding Problem Classifier and Problem Recommendation
Scrapy Sipac Processos
⭐
11
API que retorna as movimentações dos processos de auxílio estudantil da UFPB.
Telegram Scraper Api
⭐
11
An easy-to-use PHP api for Getting contents of Telegram's public channels and groups Messages without needing to join them.
Puregym Tracker
⭐
11
A simple shell script written to scrape gym activity data from the PureGym website members' area.
Iscrape
⭐
10
A basic web scrapper for Instagram
Scrap Otomoto
⭐
10
Program for scraping otomoto.pl
Flashscorescraping
⭐
10
🤖 Web Scrape to Flashcore
Alibaba_scraper
⭐
10
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Subchase
⭐
10
Chase subdomains by parsing the results of Google and Yandex search results
Songspk Musicscrapper
⭐
10
A Python Script which scrapes out all the Songs URL from SongsPK and store it in a SQLite3 Database
Steam Profit Maker
⭐
10
Find profitable games from which trading cards or items fall whose value exceeds the cost of the game itself.
Cotoami Scraper
⭐
10
Cotoami Scraper is a Chrome Extension that scrapes web pages to generate inputs for Cotoami knowledge-bases.
Pga Tour Data Science Project
⭐
10
Scrapyteer
⭐
9
Web crawling & scraping framework for Node.js on top of headless Chrome browser
Linkedin Scraper
⭐
9
Selenium based LinkedIn profile data scraper
Auto Registrar
⭐
9
A CLI script to check/register courses from KFUPM Banner 9.
Croncert Config
⭐
9
configuration and github actions for concertcloud.live (fka croncert.ch), a website that shows you concerts in various cities
Bandeco Twitter Bot
⭐
9
[PT_BR] Bot do RU da USP-SC para o Twitter
Justdial Scrapper
⭐
9
A 100% working Justdial scrapper, Just enter the url and it'll extract business info from it
Results_fetcher
⭐
9
Facilitates retrieval of large amounts of data from GITAM's results platform
Amazonbestsellerbooksscraper
⭐
8
This program scrapes Amazon to get book data (the ISBN, title, author, price, etc.) of the top 100 Best Selling books in EVERY category and every subcategory in both US and International domains. Download EXE from here:
Page To Html Converter
⭐
8
An app that scrapes a url and return the page's HTML source, without including HTML presentation attributes
Linuxjournalripper
⭐
8
On August 7, 2019 Linux Journal shut its doors for good. The website is partially unprotected but will be also shut down. This is an emergency script make to download old issues of Linux Journal in PDF !
Duckduckgo
⭐
8
A simple DuckDuckGo URL scraper.
Scrape Search Engine
⭐
8
Search anything on the different Search Engine's it will collect all the links.
Nhkore
⭐
8
🇯🇵📰🗻 NHK News Web (Easy) word frequency (core list) scraper for Japanese language learners.
Dcurooms
⭐
8
A command line tool used to display room information and book and request rooms.
Stock Informer
⭐
8
📈 A small and simple DOM detection changer for when you're in desperate need of a new Nvidia graphics card or anything else that tickles your pickle.
Web Scraping
⭐
8
web scraping and search portal using postgres full-text search, web admin built with angular + ng-zorro, web portal built with reactjs + tailwindcss
Web Scraping
⭐
8
Scrapping webpages
Oloviz
⭐
7
🍟 Scrape your Foodpanda and Deliveroo orders
Engine
⭐
7
Owl Engine – The Open Source Web Scraper Engine
Sanfoundry Dl
⭐
7
This helps script to extract all of the multiple-choice questions found on "www.sanfoundry.com"
Crawling Book
⭐
7
🧾🔍 끝내주는 크롤링&메크로 스크립트를 작성하는 방법 (with Python)
Scrawler
⭐
7
Declarative, scriptable web robot (crawler) and scrapper
Webdigger
⭐
7
Find files on web servers.
Instagram Scraping
⭐
7
Python script to scrap deskgram (Deskgram is a desktop version of Instagram)
Dubai Housing Prices
⭐
7
ML model trained on data from Bayut.com to predict housing prices in Dubai
Sih2022 Interface
⭐
7
An interface for viewing different problem statements of smart india hackathon 2022 with basic summary built with ❤️ using streamlit
Mfox Dl
⭐
7
A manga fox downloader
Bing Scraper
⭐
6
The bingscraper is python3 package which extracts the text and images content on search engine 'bing.com'
Xvlib
⭐
6
A Python package for scrapping at xvideos.com easily.
Vinted Views Generator
⭐
6
An incredibly useful bot to increase your Vinted views and sales.
Scrape Amazon
⭐
6
Scrape production information on Amazon
Python Telegram2rss
⭐
6
A python library to fetch data from public Telegram channels to use them as a python object or RSS feed.
A2oj Online Judge Category Wise Problems List
⭐
6
Firstly, I like to thank "Ahmed Aly" for making this awesome site. This site is very helpful for the programmer. Recently I came to know that, this site will be no more. So I want to collect the problem set for future uses.
Producthunt Scraper
⭐
6
Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.
Football Odds Reliability Predictor
⭐
6
Detect the most trustworthy tomorrow's English Premier League game (if any), based on historical betting odds data and the given odds for the upcoming matches.
Zoominfo_scraper
⭐
6
Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Bilibili_uploader_analyze
⭐
6
🍥Scrape some uploaders' information in Bilibili_Bilibili Up主爬虫
Faqs Automatic Scraper
⭐
6
Automatic Scraping project for extracting FAQ and Help center articles
Ifood Scraper
⭐
6
iFood scrapper, scraped restaurant data, and examples on how to use the API
Scienceaccessibility
⭐
6
Analysis of accessibility of science writing.
Instagramcrawler
⭐
5
A python script to crawl the Instagram profiles and scrape information (posts, followers, following, comments etc.)
Web Scraping With Scrapy
⭐
5
This project aims to scrap a US government website using the Scrapy framework
Ebay Scraper
⭐
5
Get the average price of a product on eBay or a list of products on sales.
Mobify
⭐
5
Download a webpage as an e-book
Yts Torrent Scrapper
⭐
5
A Python Program Based On BeautifulSoup To Search The User's Desired Movies On https://yts.mx And Return Movies And Torrent Info
Otokuna
⭐
5
A system and web app to discover good deals of rental properties, built and automated on a serverless architecture.
Reddit Scraper
⭐
5
Web scraper/crawler of Reddit page
Websearch
⭐
5
Hi! For TWT's August Code-Jam we were tasked to create a "generator" themed project. Our team, Shivansh , FunkyMonkey, NMarco, wowzers, decided to create a website generator. Our project will ask the user for an input and then return a website on it with a definition, some fun facts on it, Youtube videos, news articles and relevant images. Have Fun!
Morieapi
⭐
5
Morie API is a collection of free APIs that you can use whenever you need, just like the name Morie comes from Japanese which means a forest with many trees, that's how this project describes a collection of APIs or is called a tree.
Scraper
⭐
5
obtain information from any website, just by using its URL and the target CSS class that you want to scrape. It doesn't have a predefined purpose, so you can use it to gather information from any site you like
Deep_search_gatherer
⭐
5
A complete bot that can post link on discord for every news from Twitter/Reddit/Youtube channel/RSS feeds or any website you decided to follow
Smart Crawler
⭐
5
A smart distributed crawler that infers navigation models of structured websites, used to cluster pages based on their structure and extract data from them.
Airbnkey
⭐
5
This capstone project aims to utilize machine learning to predict the earning power of a room rented out on Airbnb.
101-167 of 167 search results
< Previous
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.