Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Evaluation Metrics Open Source Projects

Open source projects categorized as Evaluation Metrics
Categories > Evaluation Metrics
Ab3dmot ⭐ 1,511
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
most recent commit a year ago
Deepeval ⭐ 1,070
The Evaluation Framework for LLMs
total releases 107most recent commit 5 months ago
Octis ⭐ 647
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
total releases 34most recent commit 6 months ago
Rliable ⭐ 588
[NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.
dependent packages 5total releases 9most recent commit a year agopypi rliable} Downloads
Multi Human Parsing ⭐ 564
🔥🔥Official Repository for Multi-Human-Parsing (MHP)🔥🔥
most recent commit 3 years ago
Image Similarity Measures ⭐ 482
📈 Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.
dependent packages 2total releases 12most recent commit 5 months agopypi image-similarity-measures} Downloads
Pynlpl ⭐ 466
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP spec
dependent packages 3total releases 102most recent commit 10 months agopypi PyNLPl} Downloads
Jiwer ⭐ 440
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
dependent packages 44total releases 20most recent commit 10 months agopypi jiwer} Downloads
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32most recent commit 6 months agopypi unbabel-comet} Downloads
Specvqgan ⭐ 262
Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)
most recent commit a year ago
Ranx ⭐ 228
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
dependent packages 3total releases 45most recent commit 7 months agopypi ranx} Downloads
Agentops ⭐ 215
Python SDK for agent evals and observability
total releases 13most recent commit 5 months ago
Cleval ⭐ 172
CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks
most recent commit 8 months ago
Lrv Instruction ⭐ 160
[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
most recent commit 5 months ago
Pyrouge ⭐ 155
A Python wrapper for the ROUGE summarization evaluation package
dependent packages 3total releases 3most recent commit 5 years agopypi pyrouge} Downloads
Ner Evaluation ⭐ 153
An implementation of a full named-entity evaluation metrics based on SemEval'13 Task 9 - not at tag/token level but considering all the tokens that are part of the named-entity
most recent commit 3 years ago
Pythonrouge ⭐ 142
Python wrapper for evaluating summarization quality by ROUGE package
most recent commit 4 years ago
Easse ⭐ 141
Easier Automatic Sentence Simplification Evaluation
most recent commit 9 months ago
Tonic_validate ⭐ 128
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
most recent commit 5 months ago
Nervaluate ⭐ 125
Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13
dependent packages 2total releases 6most recent commit 5 months agopypi nervaluate} Downloads
Generative Evaluation Prdc ⭐ 121
Code base for the precision, recall, density, and coverage metrics for generative models. ICML 2020.
dependent packages 1total releases 2most recent commit 4 years agopypi prdc} Downloads
Pysodevaltoolkit ⭐ 112
PySODEvalToolkit: A Python-based Evaluation Toolbox for Salient Object Detection and Camouflaged Object Detection
most recent commit a year ago
Person Reid Evaluation ⭐ 104
GOM：New Metric for Re-identification. 👉GOM explicitly balances the effect of performing retrieval and verification into a single unified metric.
most recent commit a year ago
The 10 Most Depended On Evaluation Metrics Open Source Projects
Jiwer ⭐ 440
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
dependent packages 44total releases 20latest release August 31, 2023most recent commit 10 months agopypi jiwer} Downloads
Rliable ⭐ 588
[NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.
dependent packages 5total releases 9latest release June 22, 2022most recent commit a year agopypi rliable} Downloads
Permetrics ⭐ 33
Artificial intelligence (AI, ML, DL) performance metrics implemented in Python
dependent packages 4total releases 19latest release August 25, 2023most recent commit 10 months agopypi permetrics} Downloads
Fast_bss_eval ⭐ 82
A fast implementation of bss_eval metrics for blind source separation
dependent packages 4total releases 7latest release June 07, 2022most recent commit 2 years agopypi fast-bss-eval} Downloads
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32latest release October 23, 2023most recent commit 6 months agopypi unbabel-comet} Downloads
Rouge ⭐ 34
A Javascript implementation of the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) evaluation metric for summaries.
dependent packages 3total releases 4latest release December 25, 2014most recent commit 7 years agonpm rouge} Downloads
Pyrouge ⭐ 155
A Python wrapper for the ROUGE summarization evaluation package
dependent packages 3total releases 3latest release October 08, 2016most recent commit 5 years agopypi pyrouge} Downloads
Ranx ⭐ 228
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
dependent packages 3total releases 45latest release November 28, 2023most recent commit 7 months agopypi ranx} Downloads
The 10 Latest Releases In Evaluation Metrics Open Source Projects
Agentops ⭐ 215
Python SDK for agent evals and observability
total releases 13latest release January 07, 2024most recent commit 5 months ago
Deepeval ⭐ 1,070
The Evaluation Framework for LLMs
total releases 107latest release December 10, 2023most recent commit 5 months ago
Ranx ⭐ 228
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
dependent packages 3total releases 45latest release November 28, 2023most recent commit 7 months agopypi ranx} Downloads
Codebleu ⭐ 11
Pip compatible CodeBLEU metric implementation available for linux/macos/win
total releases 10latest release November 17, 2023most recent commit 6 months ago
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32latest release October 23, 2023most recent commit 6 months agopypi unbabel-comet} Downloads
Jiwer ⭐ 440
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
dependent packages 44total releases 20latest release August 31, 2023most recent commit 10 months agopypi jiwer} Downloads
Permetrics ⭐ 33
Artificial intelligence (AI, ML, DL) performance metrics implemented in Python
dependent packages 4total releases 19latest release August 25, 2023most recent commit 10 months agopypi permetrics} Downloads
Repsys ⭐ 26
Framework for Interactive Evaluation of Recommender Systems
total releases 24latest release August 05, 2023most recent commit a year ago
Faster_coco_eval ⭐ 26
Continuation of an abandoned project fast-coco-eval
dependent packages 1total releases 4latest release July 30, 2023most recent commit 5 months agopypi faster-coco-eval} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.