Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
100projectsofcode | 1,293 | 3 years ago | 5 | mit | ||||||
A list of practical knowledge-building projects. | ||||||||||
Marginaliasearch | 711 | 3 months ago | 17 | other | HTML | |||||
Internet search engine for text-oriented websites. Indexing the small, old and weird web. | ||||||||||
Sparkler | 401 | a year ago | 55 | apache-2.0 | Java | |||||
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark. | ||||||||||
Collector Http | 162 | 2 | 6 months ago | 25 | July 09, 2023 | 29 | apache-2.0 | Java | ||
Norconex Web Crawler (or spider) is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines. | ||||||||||
Crawl Anywhere | 98 | 7 years ago | 38 | other | PHP | |||||
Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration. | ||||||||||
Bing Ip2hosts | 91 | 3 years ago | gpl-3.0 | Shell | ||||||
bingip2hosts is a Bing.com web scraper that discovers websites by IP address | ||||||||||
Node Search Engine | 79 | 13 years ago | JavaScript | |||||||
Sample search engine with web crawler, built on Node.js + CouchDB + Limestone | ||||||||||
Davedavefind | 71 | 11 years ago | 1 | other | Python | |||||
A simple search engine based on the web crawler developed in Udacity's CS101 course. | ||||||||||
Pysearch | 48 | 8 years ago | Python | |||||||
Web crawler and Search engine in Python. | ||||||||||
Telegram Search | 26 | 2 years ago | n,ull | Python | ||||||
Simple web scrapping to search from telegram |