Awesome Open Source
Awesome Open Source
Combined Topics
information-retrieval x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 649 Information Retrieval Open Source Projects on Github

Categories > Data Processing > Information Retrieval
Easyocr ⭐ 12,548
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
Gensim ⭐ 12,472
Topic Modelling for Humans
Lucene Solr ⭐ 4,175
Apache Lucene and Solr open-source search software
Screenfetch ⭐ 3,247
Fetches system/theme information in terminal for Linux desktop screenshots.
Catalyst ⭐ 2,714
Accelerated deep learning R&D
Haystack ⭐ 2,424
🔍 End-to-end Python framework for building natural language search interfaces to data. Leverages Transformers and the State-of-the-Art of NLP. Supports DPR, Elasticsearch, Hugging Face’s Hub, and much more!
Ranking ⭐ 2,192
Learning to Rank in TensorFlow
Invoicenet ⭐ 1,763
Deep neural network to extract intelligent information from invoice documents.
Knowledge Graphs ⭐ 1,000
A collection of research on knowledge graphs
Pke ⭐ 973
Python Keyphrase Extraction module
Awesome Neural Models For Semantic Match ⭐ 681
A curated list of papers dedicated to neural text (semantic) matching.
Anserini ⭐ 648
Anserini is a Lucene toolkit for reproducible information retrieval research
Talisman ⭐ 590
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
Pisa ⭐ 541
PISA: Performant Indexes and Search for Academia
Telegram Scraper ⭐ 533
telegram group scraper tool. fetch all information about group members
Resin ⭐ 523
Hardware-accelerated vector-based search engine. Available as a HTTP service or as an embedded library.
Awesome Persian Nlp Ir ⭐ 494
Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources
Osi.ig ⭐ 475
Information Gathering Instagram.
Deep Semantic Similarity Model ⭐ 472
My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014_cdssm_final.pdf.
Lucene ⭐ 461
Apache Lucene open-source search software
Ip Tracer ⭐ 456
Track any ip address with IP-Tracer. IP-Tracer is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracer.
Cdqa ⭐ 418
⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.
Sequence Semantic Embedding ⭐ 409
Tools and recipes to train deep learning models and build services for NLP tasks such as text classification, semantic search ranking and recall fetching, cross-lingual information retrieval, and question answering etc.
Rmdl ⭐ 381
RMDL: Random Multimodel Deep Learning for Classification
Sparkler ⭐ 367
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
Allrank ⭐ 354
allRank is a framework for training learning-to-rank neural models based on PyTorch.
Nlp Projects ⭐ 345
word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, information extraction (i.e., entity, relation and event extraction), knowledge graph, text generation, network embedding
Openmatch ⭐ 328
An Open-Source Package for Information Retrieval.
Getaltname ⭐ 306
Extract subdomains from SSL certificates in HTTPS sites.
Elixir Scrape ⭐ 300
Scrape any website, article or RSS/Atom Feed with ease!
Bitmagic ⭐ 294
BitMagic Library
Pyserini ⭐ 268
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
Search Engine ⭐ 258
A math-aware search engine.
Aquiladb ⭐ 248
Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.
Beir ⭐ 243
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Scilla ⭐ 236
Information Gathering tool - DNS / Subdomains / Ports / Directories enumeration
Conceptualsearch ⭐ 230
Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs
Trinity ⭐ 209
Trinity IR Infrastructure
Hdltex ⭐ 202
HDLTex: Hierarchical Deep Learning for Text Classification
Aquiladb ⭐ 200
Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.
Pwnback ⭐ 197
Burp Extender plugin that generates a sitemap of a website using Wayback Machine
Neuralqa ⭐ 192
NeuralQA: A Usable Library for Question Answering on Large Datasets with BERT
Solr ⭐ 181
Apache Solr open-source search software
Vec4ir ⭐ 179
Word Embeddings for Information Retrieval
Terrier Core ⭐ 177
Terrier IR Platform
Ranknet ⭐ 176
My (slightly modified) Keras implementation of RankNet and PyTorch implementation of LambdaRank.
Rank_bm25 ⭐ 172
A Collection of BM25 Algorithms in Python
Teaching ⭐ 167
Open-Source Information Retrieval Courses @ TU Wien
K Nrm ⭐ 157
K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling
Sf1r Lite ⭐ 154
Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search
Tutorial Utilizing Kg ⭐ 148
Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"
Forte ⭐ 143
Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/
Solr Operator ⭐ 142
Kubernetes Operator for Apache Solr
Rated Ranking Evaluator ⭐ 139
Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures
Entityduetneuralranking ⭐ 138
Entity-Duet Neural Ranking Model
Text2text ⭐ 137
Text2Text: Multilingual tokenization, embedding, search, translation, summarization, question generation, question answering, data augmentation, distance measurement
Awesome Hungarian Nlp ⭐ 133
A curated list of NLP resources for Hungarian
Quepid ⭐ 130
Not A Search Relevancy Workbench ;-). Improve your Elasticsearch and Solr search quality.
Dan Jurafsky Chris Manning Nlp ⭐ 129
My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.
Foundry ⭐ 125
The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning
Genisys ⭐ 124
Powerful Telegram Members Scraping and Adding Toolkit
Bm25 ⭐ 123
A Python implementation of the BM25 ranking function.
Parsianalyzer ⭐ 116
Persian Analyzer For Elasticsearch.
Pytrec_eval ⭐ 115
pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.
Summary ⭐ 114
summaries of all the papers I read
Flexneuart ⭐ 112
Flexible classic and NeurAl Retrieval Toolkit
Vtext ⭐ 110
Simple NLP in Rust with Python bindings
Errorlookup ⭐ 105
Simple tool for retrieving information about Windows errors codes.
Ds2i ⭐ 98
A library of inverted index data structures
Naacl2018 Fever ⭐ 98
Fact Extraction and VERification baseline published in NAACL2018
Sypht Java Client ⭐ 92
A Java client for the Sypht API
Mimir ⭐ 89
OSINT Threat Intel Interface - CLI for HoneyDB
Tutorials ⭐ 87
A tutorial series by Preferred.AI
Tika Similarity ⭐ 87
Tika-Similarity uses the Tika-Python package (Python port of Apache Tika) to compute file similarity based on Metadata features.
Sert ⭐ 85
Semantic Entity Retrieval Toolkit
Awesome Semantic Search ⭐ 84
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.
Solrplugins ⭐ 83
Dice Solr Plugins from Simon Hughes Dice.com
Pyndri ⭐ 83
pyndri is a Python interface to the Indri search engine.
Ir_datasets ⭐ 79
Provides a common interface to many IR ranking datasets.
Multiplex Plot ⭐ 70
Multiplex: visualizations that tell stories—A Python library to create and annotate beautiful network graph visualizations, text visualizations and more.
Query Wellformedness ⭐ 63
25,100 queries from the Paralex corpus (Fader et al., 2013) annotated with human ratings of whether they are well-formed natural language questions.
Parade ⭐ 63
code and data to faciliate BERT/ELECTRA for document ranking. Details refer to the paper - PARADE: Passage Representation Aggregation for Document Reranking.
Wordtokenizers.jl ⭐ 63
High performance tokenizers for natural language processing and other related tasks
Rust Stemmers ⭐ 61
A rust implementation of some popular snowball stemming algorithms
Freediscovery ⭐ 60
Web Service for E-Discovery Analytics
Vectorsinsearch ⭐ 59
Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015
Ake Datasets ⭐ 57
Large, curated set of benchmark datasets for evaluating automatic keyphrase extraction algorithms.
Ir Index Server ⭐ 56
Restful index server for teaching purposes. [I do not maintain this repository any more.]
Webdork ⭐ 55
A Python tool to automate some dorking stuff to find information disclosures.
Subdomain_shell ⭐ 54
一键调用subfinder+ksubdomain+httpx 强强联合 从域名发现-->域名验证-->获取域名标题、状态码以及响应大小 最后保存结果,简化重复操作命令
Knowledge_graph_based_intent_network ⭐ 54
Learning Intents behind Interactions with Knowledge Graph for Recommendation, WWW2021
Capreolus ⭐ 54
A toolkit for end-to-end neural ad hoc retrieval
Bookworm ⭐ 54
📚 social networks from novels
Ml4ir ⭐ 53
Machine Learning for Information Retrieval
Textrank Keyword Extraction ⭐ 51
Keyword extraction using TextRank algorithm after pre-processing the text with lemmatization, filtering unwanted parts-of-speech and other techniques.
Patzilla ⭐ 50
PatZilla is a modular patent information research platform and data integration toolkit with a modern user interface and access to multiple data sources.
Cunvsm ⭐ 49
Neural Vector Space Models
Perke ⭐ 49
A keyphrase extractor for Persian
Drhard ⭐ 48
Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track (SIGIR 2021 Full Paper).
Gaanaapi ⭐ 48
Unofficial Gaana API
1-100 of 649 projects

Related Projects

Python Information Retrieval Projects (303)
Search Engine Information Retrieval Projects (112)
Java Information Retrieval Projects (78)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021