Awesome Open Source

Programming Languages

Search results for proxy scraper

55 search results found

Ferret ⭐ 5,540

Declarative web scraping

Cloudproxy ⭐ 1,235

Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.

Stealth ⭐ 923

🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy

[Unmaintained] A simple and clean video/music/image downloader 👾

Secret Agent ⭐ 575

The web scraper that's nearly impossible to block - now called @ulixee/hero

Se Scraper ⭐ 477

Javascript scraping module based on puppeteer for many different search engines...

Scrapy Zyte Smartproxy ⭐ 348

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

Proxy Scraper ⭐ 314

⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥

一个灵活、友好的爬虫框架

Proxy Scraper ⭐ 260

scrape proxies from more than 5 different sources and check which ones are still alive

Instagram Proxy Api ⭐ 239

CORS compliant API to access Instagram's public data

Proxyscrape ⭐ 224

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

Readablewebproxy ⭐ 195

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

Free Proxy ⭐ 176

Free proxy scraper written in python. It is pypi library - free to use.

Screenslicer ⭐ 159

Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JSON API. Currently unmaintained.

Grawler ⭐ 128

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.

Zyte Smartproxy Headless Proxy ⭐ 106

A complimentary proxy to help to use SPM with headless browsers

Proxy List ⭐ 103

A list of scrapped public proxies that is updated every 15 minutes.

A super simple multithreaded proxy scraper; scraping & checking ~80k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.

Cianparser ⭐ 83

Parser general information on the cian.ru website / Сбор данных с сайта объявлений Циан

The Fast And Advanced Discord Multi-Tool

Proxy Scraper ⭐ 78

Library for scraping free proxies lists

Lambda Scraper ⭐ 75

Use AWS Lambda functions as a proxy pool to scrape web pages.

Google Search SERP Scraper

Amazon_scraper ⭐ 64

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Local Api Examples ⭐ 64

Useful and easy to understand examples written in Node.js and .NET Core about web scraping and automated browsing with Kameleo Client

Kc Scraper ⭐ 62

A powerful open-source proxy scraper

Proxy Leecher ⭐ 60

🔎🌐Proxy-Scraper: Best Free Auto-updated HTTP proxy list Every 10 Minutes More than 65K Fresh Proxies. 🔥💣

Screen scraping and web crawling framework

Open Textbooks ⭐ 59

A library for scraping nearly every college bookstore in the US

Scraper Boilerplate ⭐ 54

Local Api Client Typescript ⭐ 54

Official JavaScript/TypeScript library for interacting with Kameleo Client

Pythonscrapybasicsetup ⭐ 54

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

Local Api Client Python ⭐ 53

Official Python library for interacting with Kameleo Client

Serpscraper ⭐ 53

🔎 Google/Bing search results scraping using PHP. Tested and working / May 13, 2020

Scraperx ⭐ 53

Library for scraping websites or apis at any scale

Premestock ⭐ 47

Monitors for restocks

Proxifier ⭐ 43

A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.

Searchscraperapi ⭐ 41

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

Beagle_scraper ⭐ 40

Scraper for categories and lists on ecommerce and other listing websites

Proxy_web_crawler ⭐ 39

Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords

Local Api Client Csharp ⭐ 39

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

Scrapy Tor ⭐ 38

Scrapy integration with Tor for anonymous web scraping

A 'Universal WHOIS' proxy server - you query it, it gives back the correct details

Shopifyscraper ⭐ 36

Shopify Scraper (not monitor)

Free Proxies And Useragents ⭐ 33

Proxies & useragents parser

Discord Spammer ⭐ 32

Advanced Discord Spammer with multiple options and auto scraping proxies!

Fulldom Server ⭐ 31

Proxy-like server that will show you the DOM of a page after JS runs

Hma Scraper ⭐ 31

Scrapes the obfuscated proxy list at proxylist.hidemyass.com

Scrapy Zyte Api ⭐ 30

Zyte API integration for Scrapy

Chainforger ⭐ 30

Proxy scraper for proxychains

Wildberries ⭐ 28

Wildberries.ru marketplace scraper using MySQL and hidemy.name proxies.

Scrapy Scrapingbee ⭐ 26

JavaScript support and proxy rotation for Scrapy with ScrapingBee.

Rotating Proxies With Python ⭐ 26

Learn about how to rotate proxies by using Python.

modular proxy framework to move and transform network packets

Hma Proxy Scraper ⭐ 25

Uses node.js to pull/parse working http proxies from Hidemyass.com

A Simple Proxy Scraper

Bet365 Live Soccer Scraper ⭐ 25

Bet365 Live Soccer Score Scraper

Instagram Monitor ⭐ 23

Instagram monitor, it will monitor post & stories.

Proxy Db ⭐ 23

Manage free and private proxies on local db for Python Projects

Download public videos on TikTok using Python with Selenium

Tbbscraper ⭐ 20

Automated website scraping over Tor

Hide your IP with free proxies using Froxy 🔄

Torchestrator ⭐ 18

Spin up Tor containers and proxy HTTP requests via these tor instances.

Proxy_scanner_scraper_aio ⭐ 18

A program that scrapes proxies off a set of URLs and scans them. Supports HTTP & SOCKs + URL harvesting.

Architeuthis ⭐ 18

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.

Vulnerable website scraper

Deal_scraper ⭐ 15

Find local deals at Walmart and Target

Product Integrations ⭐ 15

Code examples and general information

Linkedin Public Dir Companies ⭐ 14

Crawler and scraper of the public directory of companies on LinkedIn.

Proxycrawl Ruby ⭐ 14

ProxyCrawl API ruby gem for scraping and crawling

Working discord Promo gen using Webtoons

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Scraping_proxy_tor ⭐ 13

Python, Tor, Stem, Privoxy: with this tools, allow requests new connections via Tor for obtain new IP addresses.

Proxyscraper ⭐ 13

Multithreaded proxy scraper from sources list

Tg_adder_with_proxy ⭐ 13

Telegram Group Parser/Scraper and user Adder via id or username with proxy support

Scrapestack ⭐ 11

Real-Time Proxy & Web Scraping API

Php Simple Web Scraper ⭐ 11

A PHP application which runs on Heroku and dumps web site outputs including JavaScript generated contents.

Google Patents Scraper ⭐ 11

Automatically download all PDF files of searching results & their patent families found on Google Patents.

Alibaba_scraper ⭐ 10

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Hidemyass Proxies Scraper Php ⭐ 10

[SUSPENDED] Tool for scrapping fresh proxies from HideMyAss.com

CurlX a basic Curl syntax

Python Scraper Tutorial ⭐ 10

Short introduction to scraping with given steps an example of a scraper

Go Rip Git ⭐ 9

RipGit - Scanner/Scraper of git source deployed

Chino Proxy Scraper ⭐ 9

A python script that scrape proxies from frequently updated proxy sources.

Proxy Scraper ⭐ 9

Fast proxy scraper and checker, and hourly* updated public proxy list!

Instagram Scraper Python ⭐ 8

Scrape instagram followers python

Invesdwin Webproxy ⭐ 8

A parallel download manager for web scraping that supports proxy servers

Webrequest ⭐ 8

Like the requests library, but shittier.

Etcd Metrics Proxy ⭐ 8

Proxy metrics from secure etcd over http.

A Very simple free proxy list scraper.

Bloody Proxy Scraper ⭐ 7

Fast proxy scraper that scrapes proxies from 85+ URLs.

Ultra-massive Tor-based HA proxy

Lihkg Scraper ⭐ 7

A Python script for scraping LIHKG

Proxy Scraper Checker ⭐ 7

A command-line tool for scraping and checking HTTP and SOCKS5 proxies from the checkerproxy.net proxies archive

Node Proxy Pool ⭐ 7

IP Proxy collect library for Node.js

Soteria_proxy Scraper ⭐ 7

Proxy Scraper Using My Blazing Fast Soteria Proxy API

Pricingscraper ⭐ 7

A webscraper which uses anonymous proxy IP to scrape and has intelligence to delay scraping, changing iP on request etc

Zoominfo_scraper ⭐ 6

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Daycareproxy ⭐ 6

A proxy API that scrapes NYC DOH Childcare Connect and outputs JSON

Related Searches

Javascript Proxy (8,425)

Python Scraper (3,513)

Testing Proxy (3,095)

Python Proxy (3,027)

Golang Proxy (2,606)

Http Proxy (2,254)

Javascript Scraper (2,047)

Docker Proxy (1,789)

Server Proxy (1,730)

Scraper Scrape (1,534)

1-55 of 55 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.