Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 16 Web Crawler Search Engine Open Source Projects

Open source projects categorized as Web Crawler Search Engine
Categories > Data Processing > Search Engine
Categories > Data Processing > Web Crawler
100projectsofcode ⭐ 1,293
A list of practical knowledge-building projects.
most recent commit 3 years ago
Marginaliasearch ⭐ 711
Internet search engine for text-oriented websites. Indexing the small, old and weird web.
most recent commit 3 months ago
Sparkler ⭐ 401
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
most recent commit a year ago
Collector Http ⭐ 162
Norconex Web Crawler (or spider) is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.
total releases 25most recent commit 6 months ago
Crawl Anywhere ⭐ 98
Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
most recent commit 7 years ago
Bing Ip2hosts ⭐ 91
bingip2hosts is a Bing.com web scraper that discovers websites by IP address
most recent commit 3 years ago
Node Search Engine ⭐ 79
Sample search engine with web crawler, built on Node.js + CouchDB + Limestone
most recent commit 13 years ago
Davedavefind ⭐ 71
A simple search engine based on the web crawler developed in Udacity's CS101 course.
most recent commit 11 years ago
Pysearch ⭐ 48
Web crawler and Search engine in Python.
most recent commit 8 years ago
Telegram Search ⭐ 26
Simple web scrapping to search from telegram
most recent commit 2 years ago
Webbot ⭐ 19
Browser extension to simulate browsing behaviour in search engines.
most recent commit 9 months ago
Information Retrieval ⭐ 15
Elasticsearch, MongoDB, Tornado Server, RESTful API, Python, Information Retrieval, Machine Learning, Web Crawler
most recent commit a year ago
Krawler ⭐ 12
A complete multi-threaded web-crawler in Python3
most recent commit 5 years ago
Wgit ⭐ 10
Wgit allows you to crawl and extract the data you want from the web
dependent packages 1total releases 34most recent commit 4 months agorubygems wgit} Downloads
Codexdrake ⭐ 6
An open source, privacy-first, self-hosting capable and blazing fast search engine written in JavaScript. Browse anonymously and safely without the need to pay third-party APIs.
most recent commit 4 months ago
House Finder ⭐ 5
Web crawler, flat search engine and notification tool, that I use to find my new flat!
most recent commit 2 years ago
The 2 Latest Releases In Web Crawler Search Engine Open Source Projects
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.