Awesome Open Source
Awesome Open Source
Combined Topics
information-retrieval x

The Top 849 Information Retrieval Open Source Projects

Categories > Data Processing > Information Retrieval
Easyocr ⭐ 16,465
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
dependent packages 37total releases 30most recent commit 2 days agopypi easyocr} Downloads
Gensim ⭐ 13,764
Topic Modelling for Humans
dependent packages 530total releases 90most recent commit a day agopypi gensim} Downloads
Haystack ⭐ 6,155
🔍 Haystack is an open source NLP framework that leverages pre-trained Transformer models. It enables developers to quickly implement production-ready semantic search, question answering, summarization and document ranking for a wide range of NLP applications.
dependent packages 2total releases 29most recent commit 20 hours agopypi farm-haystack} Downloads
Lucene Solr ⭐ 4,310
Apache Lucene and Solr open-source search software
most recent commit 10 days ago
Screenfetch ⭐ 3,524
Fetches system/theme information in terminal for Linux desktop screenshots.
most recent commit 12 days ago
Nlpir ⭐ 3,251
most recent commit 9 days ago
Catalyst ⭐ 2,999
Accelerated deep learning R&D
dependent packages 10total releases 108most recent commit 2 months agopypi catalyst} Downloads
Ranking ⭐ 2,554
Learning to Rank in TensorFlow
dependent packages 11total releases 19most recent commit a month agopypi tensorflow-ranking} Downloads
Invoicenet ⭐ 1,763
Deep neural network to extract intelligent information from invoice documents.
most recent commit a year ago
Marqo ⭐ 1,624
Tensor search for humans.
most recent commit a day ago
Lucene ⭐ 1,351
Apache Lucene open-source search software
most recent commit a day ago
Knowledge Graphs ⭐ 1,319
A collection of research on knowledge graphs
most recent commit 2 months ago
Pke ⭐ 1,203
Python Keyphrase Extraction module
dependent packages 1total releases 1most recent commit 6 months agopypi pke-tool} Downloads
Ip Tracer ⭐ 1,157
Track any ip address with IP-Tracer. IP-Tracer is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracer.
most recent commit 10 months ago
Anserini ⭐ 790
Anserini is a Lucene toolkit for reproducible information retrieval research
total releases 30most recent commit 20 hours ago
Pyserini ⭐ 682
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
dependent packages 6total releases 23most recent commit 8 days agopypi pyserini} Downloads
Awesome Neural Models For Semantic Match ⭐ 681
A curated list of papers dedicated to neural text (semantic) matching.
most recent commit 2 years ago
Osi.ig ⭐ 677
Information Gathering Instagram.
most recent commit 10 months ago
Beir ⭐ 661
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
dependent packages 3total releases 28most recent commit a month agopypi beir} Downloads
Pisa ⭐ 661
PISA: Performant Indexes and Search for Academia
most recent commit 3 days ago
Solr ⭐ 609
Apache Solr open-source search software
most recent commit 20 hours ago
Talisman ⭐ 590
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
dependent packages 43total releases 30most recent commit 2 years agonpm talisman} Downloads
Awesome Persian Nlp Ir ⭐ 565
Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources
most recent commit 5 months ago
Awesome Information Retrieval ⭐ 559
A curated list of awesome information retrieval resources
most recent commit 3 years ago
Resin ⭐ 556
Hardware-accelerated vector database and search engine. Available as a HTTP service or as an embedded library.
dependent packages 1total releases 1most recent commit a day agonuget StreamIndex} Downloads
Telegram Scraper ⭐ 533
telegram group scraper tool. fetch all information about group members
most recent commit a year ago
Scilla ⭐ 527
Information Gathering tool - DNS / Subdomains / Ports / Directories enumeration
total releases 64most recent commit a month ago
Gnn Recommender Systems ⭐ 523
An index of recommendation algorithms that are based on Graph Neural Networks.
most recent commit a month ago
Deep Semantic Similarity Model ⭐ 472
My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014
most recent commit 6 years ago
Awesome Federated Learning On Graph And Tabular Data ⭐ 460
Federated learning on graph and tabular data related papers, frameworks, and datasets.
most recent commit a day ago
Densephrases ⭐ 459
ACL'2021: Learning Dense Representations of Phrases at Scale; EMNLP'2021: Phrase Retrieval Learns Passage Retrieval, Too
most recent commit 7 months ago
Rocketqa ⭐ 454
🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.
total releases 2most recent commit 5 days ago
Openmatch ⭐ 435
An Open-Source Package for Information Retrieval.
most recent commit 2 months ago
Cdqa ⭐ 418
⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.
total releases 38most recent commit 3 years ago
Sequence Semantic Embedding ⭐ 409
Tools and recipes to train deep learning models and build services for NLP tasks such as text classification, semantic search ranking and recall fetching, cross-lingual information retrieval, and question answering etc.
most recent commit 4 years ago
Thinkdatastructures ⭐ 408
LaTeX source and supporting code for Think Data Structures: Algorithms and Information Retrieval in Java
most recent commit a year ago
Rmdl ⭐ 395
RMDL: Random Multimodel Deep Learning for Classification
total releases 7most recent commit 9 months ago
Sparkler ⭐ 390
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
most recent commit 9 months ago
Allrank ⭐ 354
allRank is a framework for training learning-to-rank neural models based on PyTorch.
total releases 7most recent commit a year ago
Bitmagic ⭐ 351
BitMagic Library
most recent commit a month ago
Rank_bm25 ⭐ 348
A Collection of BM25 Algorithms in Python
dependent packages 8total releases 4most recent commit 8 months agopypi rank-bm25} Downloads
Nlp Projects ⭐ 345
word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, information extraction (i.e., entity, relation and event extraction), knowledge graph, text generation, network embedding
most recent commit 2 years ago
Aquiladb ⭐ 311
An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
most recent commit 3 months ago
Teaching ⭐ 307
Open-Source Information Retrieval Courses @ TU Wien
most recent commit 6 months ago
Getaltname ⭐ 306
Extract subdomains from SSL certificates in HTTPS sites.
total releases 16most recent commit 2 years ago
Elixir Scrape ⭐ 300
Scrape any website, article or RSS/Atom Feed with ease!
dependent packages 1total releases 25most recent commit 3 years agohex scrape} Downloads
Search Engine ⭐ 258
A math-aware search engine.
most recent commit 2 years ago
Awesome Pretrained Models For Information Retrieval ⭐ 258
A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).
most recent commit a month ago
Conceptualsearch ⭐ 230
Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs
most recent commit 4 years ago
Cherche ⭐ 224
📑 Neural Search
total releases 10most recent commit 17 days ago
Pwnback ⭐ 216
Burp Extender plugin that generates a sitemap of a website using Wayback Machine
most recent commit 5 years ago
Text2text ⭐ 215
Text2Text: Crosslingual NLP/G toolkit
total releases 71most recent commit 21 days ago
Hdltex ⭐ 213
HDLTex: Hierarchical Deep Learning for Text Classification
total releases 5most recent commit 9 months ago
Gofinance ⭐ 212
Financial information retrieval and munging (stocks, ETFs, funds, currencies, ...). Libs and app written in golang. Uses multiple datasources: Yahoo Finance, Bloomberg, et cetera.
most recent commit 4 years ago
Awesome Semantic Search ⭐ 212
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.
most recent commit a month ago
Trinity ⭐ 209
Trinity IR Infrastructure
most recent commit 3 years ago
Neuralqa ⭐ 207
NeuralQA: A Usable Library for Question Answering on Large Datasets with BERT
total releases 27most recent commit a year ago
Terrier Core ⭐ 206
Terrier IR Platform
dependent packages 3total releases 10most recent commit a month ago
Forte ⭐ 205
Forte is a flexible and powerful ML workflow builder. This is part of the CASL project: http://casl-project.ai/
dependent packages 12total releases 13most recent commit 2 days agopypi forte} Downloads
Ir_datasets ⭐ 205
Provides a common interface to many IR ranking datasets.
dependent packages 5total releases 21most recent commit 8 days agopypi ir-datasets} Downloads
Vec4ir ⭐ 201
Word Embeddings for Information Retrieval
most recent commit a year ago
Aquiladb ⭐ 200
Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.
most recent commit 2 years ago
Ocrpy ⭐ 198
OCR, Archive, Index and Search: Implementation agnostic OCR framework.
total releases 12most recent commit 18 days ago
Subdomain_shell ⭐ 197
一键调用subfinder+ksubdomain+httpx 强强联合 从域名发现-->域名验证-->获取域名标题、状态码以及响应大小 最后保存结果,简化重复操作命令
most recent commit 10 months ago
Solr Operator ⭐ 191
Kubernetes Operator for Apache Solr
total releases 26most recent commit 8 days ago
Flexneuart ⭐ 182
Flexible classic and NeurAl Retrieval Toolkit
most recent commit 9 days ago
Quepid ⭐ 182
Not A Search Relevancy Workbench ;-). Improve your Elasticsearch and Solr search quality.
most recent commit 2 days ago
Tevatron ⭐ 176
Tevatron - A flexible toolkit for dense retrieval research and development.
total releases 5most recent commit 4 days ago
Gpl ⭐ 170
Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577
total releases 10most recent commit 2 months ago
Semantic Retrieval Models ⭐ 168
A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).
most recent commit 2 months ago
K Nrm ⭐ 157
K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling
most recent commit 5 years ago
Awesome Hungarian Nlp ⭐ 154
A curated list of NLP resources for Hungarian
most recent commit 2 months ago
Sf1r Lite ⭐ 154
Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search
most recent commit 8 years ago
Splade ⭐ 149
SPLADE: sparse neural search (SIGIR21, SIGIR22)
most recent commit 9 days ago
Tutorial Utilizing Kg ⭐ 148
Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"
most recent commit 4 years ago
Errorlookup ⭐ 147
Simple tool for retrieving information about Windows errors codes.
most recent commit 2 months ago
Automated Fact Checking Resources ⭐ 146
Links to conference/journal publications in automated fact-checking (resources for the TACL22 paper).
most recent commit a month ago
Rated Ranking Evaluator ⭐ 143
Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures
most recent commit a year ago
Entityduetneuralranking ⭐ 138
Entity-Duet Neural Ranking Model
most recent commit a year ago
Dan Jurafsky Chris Manning Nlp ⭐ 129
My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.
most recent commit 4 years ago
Foundry ⭐ 125
The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning
most recent commit 2 years ago
Ranx ⭐ 123
⚡️ A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
total releases 21most recent commit 12 days ago
Bm25 ⭐ 123
A Python implementation of the BM25 ranking function.
most recent commit 3 years ago
Summary ⭐ 123
summaries of all the papers I read
most recent commit 21 days ago
Parsianalyzer ⭐ 116
Persian Analyzer For Elasticsearch.
most recent commit 2 years ago
Pytrec_eval ⭐ 115
pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.
dependent packages 11total releases 3most recent commit 2 years agopypi pytrec-eval} Downloads
Knowledge_graph_based_intent_network ⭐ 114
Learning Intents behind Interactions with Knowledge Graph for Recommendation, WWW2021
most recent commit a year ago
Webdork ⭐ 110
A Python tool to automate some dorking stuff to find information disclosures.
most recent commit 8 months ago
Naacl2018 Fever ⭐ 110
Fact Extraction and VERification baseline published in NAACL2018
most recent commit a year ago
Vtext ⭐ 110
Simple NLP in Rust with Python bindings
total releases 4most recent commit 2 years ago
Annlite ⭐ 102
⚡ A fast embedded library for approximate nearest neighbor search
total releases 44most recent commit a day ago
Ds2i ⭐ 98
A library of inverted index data structures
most recent commit 4 years ago
Repconc ⭐ 97
WSDM'22 Best Paper: Learning Discrete Representations via Constrained Clustering for Effective and Efficient Dense Retrieval
most recent commit 6 months ago
Sypht Java Client ⭐ 92
A Java client for the Sypht API
total releases 4most recent commit 2 years ago
Mimir ⭐ 89
OSINT Threat Intel Interface - CLI for HoneyDB
most recent commit 4 years ago
Tika Similarity ⭐ 87
Tika-Similarity uses the Tika-Python package (Python port of Apache Tika) to compute file similarity based on Metadata features.
most recent commit 2 years ago
Multiplex Plot ⭐ 87
Multiplex: visualizations that tell stories—A Python library to create and annotate beautiful network graph visualizations, text visualizations and more.
total releases 14most recent commit 6 months ago
Sert ⭐ 85
Semantic Entity Retrieval Toolkit
most recent commit 5 years ago
Capreolus ⭐ 84
A toolkit for end-to-end neural ad hoc retrieval
most recent commit 3 months ago
Xpir ⭐ 84
XPIR: Private Information Retrieval for Everyone
most recent commit a year ago
1-100 of 849 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,121,606)
Python  (865,695)
Java  (404,416)
Php  (293,699)
Typescript  (285,088)
C Plus Plus  (252,382)
Ruby  (223,378)
C  (190,138)
Shell  (179,132)
C Sharp  (174,070)
Golang  (168,135)
Swift  (67,905)
Rust  (65,448)
R  (61,063)
Dart  (59,151)
Objective C  (57,045)
Kotlin  (51,453)
Lua  (37,172)
Matlab  (32,393)
Perl  (30,738)
Language  (29,926)
Scala  (29,146)
Haskell  (20,812)
Powershell  (20,003)
Clojure  (19,428)
Bash  (19,043)
Elixir  (17,208)
Coffeescript  (17,173)
Assembly  (15,260)
Julia  (13,695)
Processing  (13,306)
Emacs Lisp  (10,699)
Basic  (10,677)
Flow  (10,516)
Solidity  (9,601)
Erlang  (9,104)
Groovy  (8,541)
Scheme  (8,428)
Ocaml  (6,885)
Pascal  (6,720)
Hack  (6,554)
Lisp  (6,351)
Fortran  (5,737)
Elm  (5,546)
Common Lisp  (5,431)
Dlang  (4,783)
Shell Script  (4,773)
Python Library  (4,499)
Crystal  (4,424)
Scripting  (4,233)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.