Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Open Source Search Engine | 1,504 | 3 months ago | 94 | apache-2.0 | C++ | |||||
Nov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD. From gigablast dot com, which has binaries for download. See the README.md file at the very bottom of this page for instructions. | ||||||||||
Spider | 919 | a year ago | 88 | Python | ||||||
Python website crawler. | ||||||||||
Baiduspider | 872 | 2 | 3 months ago | 34 | February 10, 2022 | 48 | gpl-3.0 | Python | ||
BaiduSpider,一个爬取百度搜索结果的爬虫,目前支持百度网页搜索,百度图片搜索,百度知道搜索,百度视频搜索,百度资讯搜索,百度文库搜索,百度经验搜索和百度百科搜索。 | ||||||||||
Manspider | 779 | 5 months ago | 5 | February 18, 2022 | 12 | gpl-3.0 | Python | |||
Spider entire networks for juicy files sitting on SMB shares. Search filenames or file content - regex supported! | ||||||||||
Tweetscraper | 698 | 3 years ago | 8 | March 07, 2018 | 1 | gpl-2.0 | Python | |||
TweetScraper is a simple crawler/spider for Twitter Search without using API | ||||||||||
Alltheplaces | 502 | 2 months ago | 372 | other | Python | |||||
A set of spiders and scrapers to extract location information from places that post their location on the internet. | ||||||||||
Crawlertutorial | 310 | 10 months ago | Python | |||||||
爬蟲極簡教學(fetch, parse, search, multiprocessing, API)- PTT 為例 | ||||||||||
Magic_google | 287 | 2 | 2 years ago | 2 | June 29, 2020 | 2 | Python | |||
Google search results crawler, get google search results that you need | ||||||||||
Nudecrawler | 231 | 6 months ago | 38 | April 30, 2023 | Python | |||||
Crawl telegra.ph searching for nudes! | ||||||||||
Search Engine Google | 155 | 9 | 4 | 2 years ago | 22 | July 22, 2019 | 40 | other | PHP | |
:spider: Google client for SERPS |