Awesome Open Source

Programming Languages

Search results for search scraper

107 search results found

Devdocs ⭐ 33,315

API Documentation Browser

Getting started with Puppeteer and Chrome Headless for Web Scraping

Twitterscraper ⭐ 1,852

Scrape Twitter for Tweets

Jobfunnel ⭐ 1,533

Scrape job websites into a single spreadsheet with no duplicates.

How To Prevent Scraping ⭐ 1,417

The ultimate guide on preventing Website Scraping

Alltheplaces ⭐ 502

A set of spiders and scrapers to extract location information from places that post their location on the internet.

Google Search Scraper

Google Search Results Python ⭐ 432

Google Search Results via SERP API pip Python Package

Search Engine Parser ⭐ 416

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Search Engines Scraper ⭐ 377

Search google, bing, yahoo, and other search engines with python

Advanced python library to scrap Twitter (tweets, users) from unofficial API

Harvestman ⭐ 278

Quick and dirty web crawling.

Torrent Search Api ⭐ 258

Yet another node torrent scraper (supports iptorrents, torrentleech, torrent9, torrentz2, 1337x, thepiratebay, Yggtorrent, TorrentProject, Eztv, Yts, LimeTorrents)

Nudecrawler ⭐ 231

Crawl telegra.ph searching for nudes!

Dorks Eye ⭐ 224

Dorks Eye Google Hacking Dork Scraping and Searching Script. Dorks Eye is a script I made in python 3. With this tool, you can easily find Google Dorks. Dork Eye collects potentially vulnerable web pages and applications on the Internet or other awesome info that is picked up by Google's search bots. Author: Jolanda de Koff

Amazon Scraper ⭐ 219

A simple web scraper to extract Product Data and Pricing from Amazon

Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.

The Slash OSINT Tool

GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)

Findpapers ⭐ 164

Findpapers: A tool for helping researchers who are looking for related works

Search Engine Google ⭐ 155

🕷️ Google client for SERPS

Malscraper ⭐ 154

Scrape everything you can from MyAnimeList.net

Airbnb Scraper ⭐ 153

Airbnb Scraper: Advanced Airbnb Search using Scrapy

Zillow Scraper for Python using Selenium

Serpscrap ⭐ 125

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

Udemycoursegrabber ⭐ 125

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

Spyscrap ⭐ 124

CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.

Clone Hero-friendly Organized Repository of User-provided Songs

Googlesearch ⭐ 112

Python library for scraping google search results

Sentiment Analysis Of Financial News Data ⭐ 98

Sentiment Analysis of news on stock prices

Arxiv Miner ⭐ 94

arxiv_miner is a toolkit for mining research papers on CS ArXiv.

Bing Ip2hosts ⭐ 91

bingip2hosts is a Bing.com web scraper that discovers websites by IP address

Kijiji Scraper ⭐ 89

A lightweight node.js module for retrieving and scraping ads from Kijiji

Torrengo ⭐ 87

Torrengo is a CLI (command line) program written in Go which concurrently searches torrents from various sources.

Job_search ⭐ 85

An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components.

Amazon Reviews Scraper ⭐ 82

Yet another multi language scraper for Amazon targeting reviews.

Flight_scraper ⭐ 77

Flight Fare & Seat Availability Scraper Library

Node Google Search Scraper ⭐ 76

Google search scraper with captcha solving support

Scraping Ebay ⭐ 73

Scraping Ebay's products using Scrapy Web Crawling Framework

Craigslist_scraper ⭐ 73

A gem to scrape and analyze craigslist data

Shutterscrape ⭐ 73

Speedy, lightweight web scrapper for Shutterstock.

Google Search SERP Scraper

A PHP Scraping Class

Google Emailscraper ⭐ 60

Scraper that searches Google based on a query and scrapes all emails found on each page.

Secraper ⭐ 60

Search engine scraper tool with BASH script.

Serpscraper ⭐ 53

🔎 Google/Bing search results scraping using PHP. Tested and working / May 13, 2020

Fucking Search Engines Scraper - python library to scrap url's from search engines

Swiftscraper ⭐ 45

Web scraping library for Swift

Searchscraperapi ⭐ 41

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

Proxy_web_crawler ⭐ 39

Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords

Image Collector ⭐ 38

Download images from Google Image Search

Comcrawl ⭐ 37

A python utility for downloading Common Crawl data

Crawling, scraping and indexing application written in Clojure.

Pornhub Api ⭐ 36

A powerful and complete scrapper for the very famous pornhub.com. This javascript module for node give you the possibility, through an API with many options, to scrap any information out of a page or the search page.

Pysoc.js ⭐ 35

😎 Simple gsoc data scraper, search for any keyword and instantly get data about the orgs that match your search criteria, use filters to sort and analyse the data, uses fuzzy-searching to improve user-search experience

Firebase Extractor ⭐ 34

A tool written in python for scraping firebase data

Gscraper ⭐ 33

A web-scraping interface to various Google Services.

Golinkedin ⭐ 31

Golinkedin is a library written in pure golang for scraping Linkedin

Monkeyshines ⭐ 31

A simple, lightweight scraper for huffing API or feed data (rather than a page-by-page wander)

Ocamloscope.2 ⭐ 31

OCamlOScope 2 : OCaml API search

Python Searchengine ⭐ 31

A simple search engine which utilizes whoosh, mongodb, a custom html scraper and simple crawler.

Xpath Selector ⭐ 28

Library implementing easy XPath queries. Very useful for HTML and XML web scraping.

Craigslistscraper ⭐ 27

Simple webscraper for Craigslist.

Video Crawler ⭐ 26

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

Fb Uid Scraper ⭐ 26

Facebook UID Scraper - Chrome extension https://www.upwork.com/freelancers/~01db3734d9601b

Telegram Search ⭐ 26

Simple web scrapping to search from telegram

Search your favorite PS4 games from Playstation Store using the Command Line

Google Leads Scraper ⭐ 25

A simple tool that makes it easy for marketers to extract emails and phone numbers (leads) from google search results.

Perform Google Dork search with Dorkify

Bluebird ⭐ 23

Unofficial Python client for Twitter

Searchenginepy ⭐ 20

search engine for python (Query and scrape search engines)

Torrent Indexer ⭐ 20

Yet another node.js torrent scraper made especially for movie, series, anime and music (scrape from 1337x, eztv, limetorrents, rarbg, skytorrents, thepiratebay, torrentproject, yts and zooqle)

Actor Youtube Scraper ⭐ 20

Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.

Scrapy Azuresearch Crawler Samples ⭐ 19

Scrapy as a Web Crawler for Azure Search Samples

Browser extension to simulate browsing behaviour in search engines.

Tg Keyword Trends ⭐ 18

This script searches messages containing specified search terms in Telegram channels the user is a member of.

Sinaweiboscraper ⭐ 18

Web Scraper for Sina Weibo Search by Keywords

Mangareaderscraper ⭐ 17

Search and download mangas from the command line

Pypatent ⭐ 16

Search for and retrieve US Patent and Trademark Office Patent Data

Roots Search ⭐ 15

Search popular genealogy websites

Immoweb Keeper ⭐ 15

Create your own long term database of Immoweb photos and metadata based on criterias

Kaufman Bot ⭐ 14

Simple bot for telegram

Chrome Web Store Scraper ⭐ 14

A node js package for scraping the chrome web store. `npm i chrome-web-store-scraper`

Vim React Goto Definition ⭐ 14

Goto definition pluigin for React JS written in Python

Gs Scraper ⭐ 14

A little app that searches multiple sources for items and garage sales (Craigslist, LetGo, OfferUp, VarageSale, Oodle, EstateSales.net). It also allows you to use eBay's finding API to search prices on eBay and compare.

Google Image Search Scraper ⭐ 14

do a google image search and download the images

Yggtorrentscraper ⭐ 13

YggTorrent scraper

Bdo Scraper ⭐ 13

A scraper for BDDatabase.net.

Search engine results page scraper

Php Imdb ⭐ 13

A PHP 5.3 library for scraping IMDb

Scrapingfromourown ⭐ 13

Inofficial AO3 scraper and primitive API.

Search for videos, playlists, channels, movies. live and musics on youtube without api key.

A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...

Googleit ⭐ 12

Get results from search engines.

Cep Scraper ⭐ 12

A Javascript client to search Brazilian postcodes

Google Search Results Nodejs ⭐ 11

Scrape and parse Google search results in Node.JS

Twitscrape ⭐ 11

Twitscrape is a library written in Go that allows you to search for tweets without authentication!

Vocabulary Scrapper ⭐ 10

This is a django app for getting the meaning of an English word from command line.

Python Googleplay ⭐ 10

Simple Python module for scraping Google Play search

Investable ⭐ 10

A web app used to research potential rental real estate investments.

Related Searches

Javascript Search (7,741)

Python Search (5,943)

Python Scraper (3,513)

Java Search (2,349)

Javascript Scraper (2,047)

Ruby Search (1,767)

Google Search (1,561)

Scraper Scrape (1,534)

Scraper Web Crawler (1,528)

Html Search (1,308)

1-100 of 107 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.