Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Evaluation Framework Open Source Projects

Open source projects categorized as Evaluation Framework
Categories > Evaluation Framework
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3most recent commit 5 months agopypi lm-eval} Downloads
Promptfoo ⭐ 1,785
Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & private models like Mistral/Mixtral/Llama with CI/CD
total releases 78most recent commit 5 months ago
Deepeval ⭐ 1,070
The Evaluation Framework for LLMs
total releases 107most recent commit 5 months ago
Recsys2019_deeplearning_evaluation ⭐ 871
This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.
most recent commit 2 years ago
Pydgn ⭐ 211
A research library for automating experiments on Deep Graph Networks
total releases 7most recent commit 5 months ago
Zeno ⭐ 202
AI Data Management & Evaluation Platform
dependent packages 3total releases 51most recent commit 9 months agopypi zenoml} Downloads
Expressive ⭐ 146
Expressive is a cross-platform expression parsing and evaluation framework. The cross-platform nature is achieved through compiling for .NET Standard so it will run on practically any platform.
dependent packages 1total releases 18most recent commit a year agonuget ExpressiveParser} Downloads
Tonic_validate ⭐ 128
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
most recent commit 5 months ago
Pysodevaltoolkit ⭐ 112
PySODEvalToolkit: A Python-based Evaluation Toolbox for Salient Object Detection and Camouflaged Object Detection
most recent commit a year ago
Crowdflow ⭐ 92
Optical Flow Dataset and Benchmark for Visual Crowd Analysis
most recent commit a year ago
Continuous Eval ⭐ 78
Evaluation for LLM / RAG pipelines, ready for CI/CD
most recent commit 5 months ago
Lm Evaluation ⭐ 69
Evaluation suite for large-scale language models.
most recent commit 3 years ago
Sordi Ai Evaluation Gui ⭐ 68
This repository allows you to evaluate a trained computer vision model and get general information and evaluation metrics with little configuration.
most recent commit 8 months ago
Rankeval ⭐ 65
Official repository of RankEval: An Evaluation and Analysis Framework for Learning-to-Rank Solutions.
most recent commit 4 years ago
Birl ⭐ 63
BIRL: Benchmark on Image Registration methods with Landmark validations
most recent commit 2 years ago
Dialogentailment ⭐ 62
The implementation of the paper "Evaluating Coherence in Dialogue Systems using Entailment"
most recent commit 2 years ago
Vectory ⭐ 56
Vectory provides a collection of tools to track and compare embedding versions.
total releases 8most recent commit 2 years ago
Athina Evals ⭐ 45
Python SDK for running evaluations on LLM generated responses
most recent commit 5 months ago
Od Test ⭐ 44
OD-test: A Less Biased Evaluation of Out-of-Distribution (Outlier) Detectors (PyTorch)
most recent commit 5 years ago
Evalify ⭐ 41
Evaluate your biometric verification models literally in seconds.
total releases 5most recent commit a year ago
Sim4rec ⭐ 37
Simulator for training and evaluation of Recommender Systems
total releases 2most recent commit 8 months ago
Kolena ⭐ 37
Python client for Kolena's machine learning testing platform
most recent commit 5 months ago
Pactus ⭐ 37
Framework to evaluate Trajectory Classification Algorithms
total releases 14most recent commit 9 months ago
The 4 Most Depended On Evaluation Framework Open Source Projects
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3latest release December 08, 2022most recent commit 5 months agopypi lm-eval} Downloads
Zeno ⭐ 202
AI Data Management & Evaluation Platform
dependent packages 3total releases 51latest release July 26, 2023most recent commit 9 months agopypi zenoml} Downloads
Galileo ⭐ 10
🪐 A framework for distributed load testing experiments
dependent packages 2total releases 19latest release March 30, 2022most recent commit a year agopypi edgerun-galileo} Downloads
The 10 Latest Releases In Evaluation Framework Open Source Projects
Deepeval ⭐ 1,070
The Evaluation Framework for LLMs
total releases 107latest release December 10, 2023most recent commit 5 months ago
Pactus ⭐ 37
Framework to evaluate Trajectory Classification Algorithms
total releases 14latest release September 16, 2023most recent commit 9 months ago
Thresh ⭐ 9
🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
total releases 5latest release August 14, 2023most recent commit 9 months ago
Repsys ⭐ 26
Framework for Interactive Evaluation of Recommender Systems
total releases 24latest release August 05, 2023most recent commit a year ago
Sim4rec ⭐ 37
Simulator for training and evaluation of Recommender Systems
total releases 2latest release August 01, 2023most recent commit 8 months ago
Zeno ⭐ 202
AI Data Management & Evaluation Platform
dependent packages 3total releases 51latest release July 26, 2023most recent commit 9 months agopypi zenoml} Downloads
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3latest release December 08, 2022most recent commit 5 months agopypi lm-eval} Downloads
Vectory ⭐ 56
Vectory provides a collection of tools to track and compare embedding versions.
total releases 8latest release October 25, 2022most recent commit 2 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.