Awesome Open Source
Awesome Open Source
Combined Topics
information-retrieval x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 675 Information Retrieval Open Source Projects on Github

Categories > Data Processing > Information Retrieval
Easyocr ⭐ 13,617
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
Gensim ⭐ 12,826
Topic Modelling for Humans
Lucene Solr ⭐ 4,229
Apache Lucene and Solr open-source search software
Haystack ⭐ 3,828
🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.
Screenfetch ⭐ 3,306
Fetches system/theme information in terminal for Linux desktop screenshots.
Catalyst ⭐ 2,813
Accelerated deep learning R&D
Ranking ⭐ 2,343
Learning to Rank in TensorFlow
Invoicenet ⭐ 1,763
Deep neural network to extract intelligent information from invoice documents.
Knowledge Graphs ⭐ 1,115
A collection of research on knowledge graphs
Pke ⭐ 1,013
Python Keyphrase Extraction module
Ip Tracer ⭐ 726
Track any ip address with IP-Tracer. IP-Tracer is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracer.
Anserini ⭐ 704
Anserini is a Lucene toolkit for reproducible information retrieval research
Awesome Neural Models For Semantic Match ⭐ 681
A curated list of papers dedicated to neural text (semantic) matching.
Lucene ⭐ 678
Apache Lucene open-source search software
Talisman ⭐ 590
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
Osi.ig ⭐ 558
Information Gathering Instagram.
Pisa ⭐ 552
PISA: Performant Indexes and Search for Academia
Resin ⭐ 546
Hardware-accelerated vector database and search engine. Available as a HTTP service or as an embedded library.
Telegram Scraper ⭐ 533
telegram group scraper tool. fetch all information about group members
Awesome Persian Nlp Ir ⭐ 494
Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources
Deep Semantic Similarity Model ⭐ 472
My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014_cdssm_final.pdf.
Cdqa ⭐ 418
⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.
Sequence Semantic Embedding ⭐ 409
Tools and recipes to train deep learning models and build services for NLP tasks such as text classification, semantic search ranking and recall fetching, cross-lingual information retrieval, and question answering etc.
Pyserini ⭐ 394
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
Rmdl ⭐ 390
RMDL: Random Multimodel Deep Learning for Classification
Densephrases ⭐ 390
ACL'2021: Learning Dense Representations of Phrases at Scale; EMNLP'2021: Phrase Retrieval Learns Passage Retrieval, Too
Sparkler ⭐ 382
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
Openmatch ⭐ 359
An Open-Source Package for Information Retrieval.
Allrank ⭐ 354
allRank is a framework for training learning-to-rank neural models based on PyTorch.
Nlp Projects ⭐ 345
word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, information extraction (i.e., entity, relation and event extraction), knowledge graph, text generation, network embedding
Beir ⭐ 327
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Solr ⭐ 325
Apache Solr open-source search software
Bitmagic ⭐ 313
BitMagic Library
Getaltname ⭐ 306
Extract subdomains from SSL certificates in HTTPS sites.
Elixir Scrape ⭐ 300
Scrape any website, article or RSS/Atom Feed with ease!
Scilla ⭐ 299
Information Gathering tool - DNS / Subdomains / Ports / Directories enumeration
Aquiladb ⭐ 266
An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
Search Engine ⭐ 258
A math-aware search engine.
Conceptualsearch ⭐ 230
Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs
Trinity ⭐ 209
Trinity IR Infrastructure
Genisys ⭐ 208
Powerful Telegram Members Scraping and Adding Toolkit
Neuralqa ⭐ 207
NeuralQA: A Usable Library for Question Answering on Large Datasets with BERT
Hdltex ⭐ 202
HDLTex: Hierarchical Deep Learning for Text Classification
Vec4ir ⭐ 201
Word Embeddings for Information Retrieval
Aquiladb ⭐ 200
Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.
Pwnback ⭐ 197
Burp Extender plugin that generates a sitemap of a website using Wayback Machine
Teaching ⭐ 190
Open-Source Information Retrieval Courses @ TU Wien
Terrier Core ⭐ 180
Terrier IR Platform
Ranknet ⭐ 176
My (slightly modified) Keras implementation of RankNet and PyTorch implementation of LambdaRank.
Rank_bm25 ⭐ 172
A Collection of BM25 Algorithms in Python
Text2text ⭐ 162
Text2Text: Cross-lingual natural language processing and generation toolkit
Solr Operator ⭐ 157
Kubernetes Operator for Apache Solr
K Nrm ⭐ 157
K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling
Sf1r Lite ⭐ 154
Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search
Forte ⭐ 154
Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/
Rocketqa ⭐ 153
🚀RocketQA
Tutorial Utilizing Kg ⭐ 148
Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"
Quepid ⭐ 147
Not A Search Relevancy Workbench ;-). Improve your Elasticsearch and Solr search quality.
Rated Ranking Evaluator ⭐ 143
Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures
Ir_datasets ⭐ 139
Provides a common interface to many IR ranking datasets.
Entityduetneuralranking ⭐ 138
Entity-Duet Neural Ranking Model
Awesome Semantic Search ⭐ 138
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.
Flexneuart ⭐ 138
Flexible classic and NeurAl Retrieval Toolkit
Awesome Hungarian Nlp ⭐ 135
A curated list of NLP resources for Hungarian
Gnn Recommender Systems ⭐ 132
An index of recommendation algorithms that are based on Graph Neural Networks.
Dan Jurafsky Chris Manning Nlp ⭐ 129
My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.
Foundry ⭐ 125
The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning
Errorlookup ⭐ 123
Simple tool for retrieving information about Windows errors codes.
Bm25 ⭐ 123
A Python implementation of the BM25 ranking function.
Summary ⭐ 118
summaries of all the papers I read
Parsianalyzer ⭐ 116
Persian Analyzer For Elasticsearch.
Pytrec_eval ⭐ 115
pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.
Vtext ⭐ 110
Simple NLP in Rust with Python bindings
Naacl2018 Fever ⭐ 98
Fact Extraction and VERification baseline published in NAACL2018
Tutorials ⭐ 98
A tutorial series by Preferred.AI
Ds2i ⭐ 98
A library of inverted index data structures
Webdork ⭐ 97
A Python tool to automate some dorking stuff to find information disclosures.
Sypht Java Client ⭐ 92
A Java client for the Sypht API
Mimir ⭐ 89
OSINT Threat Intel Interface - CLI for HoneyDB
Tika Similarity ⭐ 87
Tika-Similarity uses the Tika-Python package (Python port of Apache Tika) to compute file similarity based on Metadata features.
Sert ⭐ 85
Semantic Entity Retrieval Toolkit
Pyndri ⭐ 83
pyndri is a Python interface to the Indri search engine.
Solrplugins ⭐ 83
Dice Solr Plugins from Simon Hughes Dice.com
Capreolus ⭐ 70
A toolkit for end-to-end neural ad hoc retrieval
Multiplex Plot ⭐ 70
Multiplex: visualizations that tell stories—A Python library to create and annotate beautiful network graph visualizations, text visualizations and more.
Ml4ir ⭐ 64
Machine Learning for Information Retrieval
Query Wellformedness ⭐ 63
25,100 queries from the Paralex corpus (Fader et al., 2013) annotated with human ratings of whether they are well-formed natural language questions.
Parade ⭐ 63
code and data to faciliate BERT/ELECTRA for document ranking. Details refer to the paper - PARADE: Passage Representation Aggregation for Document Reranking.
Wordtokenizers.jl ⭐ 63
High performance tokenizers for natural language processing and other related tasks
Rust Stemmers ⭐ 61
A rust implementation of some popular snowball stemming algorithms
Freediscovery ⭐ 60
Web Service for E-Discovery Analytics
Vectorsinsearch ⭐ 59
Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015
Ake Datasets ⭐ 57
Large, curated set of benchmark datasets for evaluating automatic keyphrase extraction algorithms.
Ir Index Server ⭐ 56
Restful index server for teaching purposes. [I do not maintain this repository any more.]
Semantic Retrieval Models ⭐ 55
A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).
Bookworm ⭐ 54
📚 social networks from novels
Knowledge_graph_based_intent_network ⭐ 54
Learning Intents behind Interactions with Knowledge Graph for Recommendation, WWW2021
Drhard ⭐ 54
Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track (SIGIR 2021 Full Paper).
Subdomain_shell ⭐ 54
一键调用subfinder+ksubdomain+httpx 强强联合 从域名发现-->域名验证-->获取域名标题、状态码以及响应大小 最后保存结果,简化重复操作命令
Textrank Keyword Extraction ⭐ 51
Keyword extraction using TextRank algorithm after pre-processing the text with lemmatization, filtering unwanted parts-of-speech and other techniques.
1-100 of 675 projects

Related Projects

Python Information Retrieval Projects (329)
Search Engine Information Retrieval Projects (118)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2022