Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Crawler Search Engine Open Source Projects

Open source projects categorized as Crawler Search Engine
Categories > Data Processing > Crawler
Categories > Data Processing > Search Engine
Googlescraper ⭐ 2,540
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
most recent commit 3 years ago
Ambar ⭐ 1,797
🔍 Ambar: Document Search Engine
most recent commit 3 years ago
Python Seo Analyzer ⭐ 956
An SEO tool that analyzes the structure of a site, crawls the site, count words in the body of the site and warns of any technical SEO issues.
total releases 22most recent commit 8 months ago
Fess ⭐ 943
Fess is very powerful and easily deployable Enterprise Search Server.
dependent packages 26total releases 148most recent commit 3 months ago
Ipfs Search ⭐ 779
Search engine for the Interplanetary Filesystem.
dependent packages 1total releases 19most recent commit a year ago
Filemasta ⭐ 646
A search application to explore, discover and share online files
most recent commit 2 years ago
Domains ⭐ 508
World’s single largest Internet domains dataset
most recent commit 6 months ago
Opensearchserver ⭐ 419
Open-source Enterprise Grade Search Engine Software
total releases 17most recent commit 3 years ago
Sparkler ⭐ 401
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
most recent commit a year ago
Search Engines Scraper ⭐ 377
Search google, bing, yahoo, and other search engines with python
total releases 2most recent commit 6 months ago
Gcse ⭐ 277
Project for Go Search, a search engine for finding popular and relevant packages.
total releases 1most recent commit 4 years ago
Collector Http ⭐ 162
Norconex Web Crawler (or spider) is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.
total releases 25most recent commit 6 months ago
Search ⭐ 126
An Open Source Search Engine
most recent commit 3 years ago
Saushengine.v1 ⭐ 118
Simple Ruby-based search engine
most recent commit 10 years ago
Ghs ⭐ 106
GitHub Search: Platform used to crawl, store and present projects from GitHub, as well as any statistics related to them.
most recent commit 3 months ago
Crawl Anywhere ⭐ 98
Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
most recent commit 7 years ago
Ahmia Crawler ⭐ 95
Collection of crawlers used by the ahmia search engine
most recent commit 2 years ago
Node Search Engine ⭐ 79
Sample search engine with web crawler, built on Node.js + CouchDB + Limestone
most recent commit 13 years ago
Couch Crawler ⭐ 77
A search engine built on top of couchdb-lucene
most recent commit 14 years ago
Davedavefind ⭐ 71
A simple search engine based on the web crawler developed in Udacity's CS101 course.
most recent commit 11 years ago
Robots.txt ⭐ 69
Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites.
most recent commit 2 years ago
Achoz ⭐ 67
Search through all your personal data efficiently like web search.
dependent packages 2total releases 38most recent commit a year agonpm achoz} Downloads
Dig Etl Engine ⭐ 65
Download DIG to run on your laptop or server.
most recent commit 5 years ago
The 4 Most Depended On Crawler Search Engine Open Source Projects
Fess ⭐ 943
Fess is very powerful and easily deployable Enterprise Search Server.
dependent packages 26total releases 148latest release October 19, 2023most recent commit 3 months ago
Achoz ⭐ 67
Search through all your personal data efficiently like web search.
dependent packages 2total releases 38latest release January 10, 2022most recent commit a year agonpm achoz} Downloads
Wgit ⭐ 10
Wgit allows you to crawl and extract the data you want from the web
dependent packages 1total releases 34latest release November 26, 2021most recent commit 3 months agorubygems wgit} Downloads
Ipfs Search ⭐ 779
Search engine for the Interplanetary Filesystem.
dependent packages 1total releases 19latest release April 20, 2021most recent commit a year ago
The 10 Latest Releases In Crawler Search Engine Open Source Projects
Legitbot ⭐ 19
🤔 Is this Web request from a real search engine🕷 or from an impersonating agent 🕵️‍♀️?
total releases 44latest release November 17, 2023most recent commit 5 months ago
Fess ⭐ 943
Fess is very powerful and easily deployable Enterprise Search Server.
dependent packages 26total releases 148latest release October 19, 2023most recent commit 3 months ago
Yggstate ⭐ 7
Yggdrasil Network Explorer
total releases 1latest release August 07, 2023most recent commit 5 months ago
Search Engines Scraper ⭐ 377
Search google, bing, yahoo, and other search engines with python
total releases 2latest release March 20, 2023most recent commit 6 months ago
Achoz ⭐ 67
Search through all your personal data efficiently like web search.
dependent packages 2total releases 38latest release January 10, 2022most recent commit a year agonpm achoz} Downloads
Wgit ⭐ 10
Wgit allows you to crawl and extract the data you want from the web
dependent packages 1total releases 34latest release November 26, 2021most recent commit 3 months agorubygems wgit} Downloads
Ipfs Search ⭐ 779
Search engine for the Interplanetary Filesystem.
dependent packages 1total releases 19latest release April 20, 2021most recent commit a year ago
Alida ⭐ 36
Crawling, scraping and indexing application written in Clojure.
total releases 4latest release February 09, 2020most recent commit 12 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.