Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Evaluation Metrics Open Source Projects

Open source projects categorized as Python Evaluation Metrics
Categories > Evaluation Metrics
Ab3dmot ⭐ 1,511
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
most recent commit a year ago
Deepeval ⭐ 1,070
The Evaluation Framework for LLMs
total releases 107most recent commit 3 months ago
Octis ⭐ 647
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
total releases 34most recent commit 4 months ago
Image Similarity Measures ⭐ 482
📈 Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.
dependent packages 2total releases 12most recent commit 3 months agopypi image-similarity-measures} Downloads
Pynlpl ⭐ 466
PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP spec
dependent packages 3total releases 102most recent commit 8 months agopypi PyNLPl} Downloads
Jiwer ⭐ 440
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
dependent packages 44total releases 20most recent commit 8 months agopypi jiwer} Downloads
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32most recent commit 4 months agopypi unbabel-comet} Downloads
Ranx ⭐ 228
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
dependent packages 3total releases 45most recent commit 5 months agopypi ranx} Downloads
Agentops ⭐ 215
Python SDK for agent evals and observability
total releases 13most recent commit 3 months ago
Cleval ⭐ 172
CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks
most recent commit 7 months ago
Lrv Instruction ⭐ 160
[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
most recent commit 3 months ago
Pyrouge ⭐ 155
A Python wrapper for the ROUGE summarization evaluation package
dependent packages 3total releases 3most recent commit 5 years agopypi pyrouge} Downloads
Ner Evaluation ⭐ 153
An implementation of a full named-entity evaluation metrics based on SemEval'13 Task 9 - not at tag/token level but considering all the tokens that are part of the named-entity
most recent commit 3 years ago
Pythonrouge ⭐ 142
Python wrapper for evaluating summarization quality by ROUGE package
most recent commit 4 years ago
Tonic_validate ⭐ 128
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
most recent commit 3 months ago
Nervaluate ⭐ 125
Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13
dependent packages 2total releases 6most recent commit 4 months agopypi nervaluate} Downloads
Pysodevaltoolkit ⭐ 112
PySODEvalToolkit: A Python-based Evaluation Toolbox for Salient Object Detection and Camouflaged Object Detection
most recent commit a year ago
Person Reid Evaluation ⭐ 104
GOM：New Metric for Re-identification. 👉GOM explicitly balances the effect of performing retrieval and verification into a single unified metric.
most recent commit a year ago
Fast_bss_eval ⭐ 82
A fast implementation of bss_eval metrics for blind source separation
dependent packages 4total releases 7most recent commit 2 years agopypi fast-bss-eval} Downloads
Erroranalysis_prompt ⭐ 79
🎁[ChatGPT4MTevaluation] ErrorAnalysis Prompt for MT Evaluation in ChatGPT
most recent commit 4 months ago
Continuous Eval ⭐ 78
Evaluation for LLM / RAG pipelines, ready for CI/CD
most recent commit 3 months ago
Factcc ⭐ 76
Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
most recent commit 3 years ago
Semantic Object Accuracy For Generative Text To Image Synthesis ⭐ 74
Code for "Semantic Object Accuracy for Generative Text-to-Image Synthesis" (TPAMI 2020)
most recent commit 3 years ago
The 10 Most Depended On Python Evaluation Metrics Open Source Projects
Jiwer ⭐ 440
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
dependent packages 44total releases 20latest release August 31, 2023most recent commit 8 months agopypi jiwer} Downloads
Fast_bss_eval ⭐ 82
A fast implementation of bss_eval metrics for blind source separation
dependent packages 4total releases 7latest release June 07, 2022most recent commit 2 years agopypi fast-bss-eval} Downloads
Permetrics ⭐ 33
Artificial intelligence (AI, ML, DL) performance metrics implemented in Python
dependent packages 4total releases 19latest release August 25, 2023most recent commit 8 months agopypi permetrics} Downloads
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32latest release October 23, 2023most recent commit 4 months agopypi unbabel-comet} Downloads
Pyrouge ⭐ 155
A Python wrapper for the ROUGE summarization evaluation package
dependent packages 3total releases 3latest release October 08, 2016most recent commit 5 years agopypi pyrouge} Downloads
Ranx ⭐ 228
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
dependent packages 3total releases 45latest release November 28, 2023most recent commit 5 months agopypi ranx} Downloads
Nervaluate ⭐ 125
Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13
dependent packages 2total releases 6latest release October 16, 2020most recent commit 4 months agopypi nervaluate} Downloads
Classeval ⭐ 5
Evaluation of supervised predictions for two-class and multi-class classifiers
dependent packages 2total releases 16latest release December 01, 2022most recent commit a year agopypi classeval} Downloads
The 10 Latest Releases In Python Evaluation Metrics Open Source Projects
Agentops ⭐ 215
Python SDK for agent evals and observability
total releases 13latest release January 07, 2024most recent commit 3 months ago
Deepeval ⭐ 1,070
The Evaluation Framework for LLMs
total releases 107latest release December 10, 2023most recent commit 3 months ago
Ranx ⭐ 228
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
dependent packages 3total releases 45latest release November 28, 2023most recent commit 5 months agopypi ranx} Downloads
Codebleu ⭐ 11
Pip compatible CodeBLEU metric implementation available for linux/macos/win
total releases 10latest release November 17, 2023most recent commit 5 months ago
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32latest release October 23, 2023most recent commit 4 months agopypi unbabel-comet} Downloads
Jiwer ⭐ 440
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
dependent packages 44total releases 20latest release August 31, 2023most recent commit 8 months agopypi jiwer} Downloads
Permetrics ⭐ 33
Artificial intelligence (AI, ML, DL) performance metrics implemented in Python
dependent packages 4total releases 19latest release August 25, 2023most recent commit 8 months agopypi permetrics} Downloads
Repsys ⭐ 26
Framework for Interactive Evaluation of Recommender Systems
total releases 24latest release August 05, 2023most recent commit 9 months ago
Faster_coco_eval ⭐ 26
Continuation of an abandoned project fast-coco-eval
dependent packages 1total releases 4latest release July 30, 2023most recent commit 3 months agopypi faster-coco-eval} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.