Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Natural Language Processing Evaluation Open Source Projects

Open source projects categorized as Natural Language Processing Evaluation
Categories > Runtime Environments > Evaluation
Categories > Machine Learning > Natural Language Processing
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3most recent commit 3 months agopypi lm-eval} Downloads
Pet ⭐ 1,543
This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"
most recent commit 10 months ago
Nlg Eval ⭐ 1,265
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
most recent commit 3 months ago
Natasha ⭐ 1,085
Solves basic Russian NLP tasks, API for lower level Natasha projects
dependent packages 9total releases 19most recent commit 7 months agopypi natasha} Downloads
Summarization Papers ⭐ 922
Summarization Papers
most recent commit 9 months ago
Alpaca_eval ⭐ 899
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
most recent commit 3 months ago
Seqeval ⭐ 866
A Python framework for sequence labeling evaluation(named-entity recognition, pos tagging, etc...)
dependent packages 165total releases 24most recent commit a year agopypi seqeval} Downloads
Openattack ⭐ 571
An Open-Source Package for Textual Adversarial Attack.
total releases 7most recent commit 9 months ago
Text2sql Data ⭐ 478
A collection of datasets that pair questions with SQL queries.
most recent commit 3 months ago
Autoprompt ⭐ 412
AutoPrompt: Automatic Prompt Construction for Masked Language Models.
most recent commit 10 months ago
Datascience_artificialintelligence_utils ⭐ 369
Examples of Data Science projects and Artificial Intelligence use-cases
most recent commit 9 months ago
Robustness Gym ⭐ 339
Robustness Gym is an evaluation toolkit for machine learning.
total releases 8most recent commit 3 years ago
Pyss3 ⭐ 307
A Python package implementing a new interpretable machine learning model for text classification (with visualization tools for Explainable AI :octocat:)
total releases 29most recent commit 8 months ago
Kss ⭐ 306
Kss: A Toolkit for Korean sentence segmentation
dependent packages 10total releases 84most recent commit 7 months agopypi kss} Downloads
Rnn.wgan ⭐ 246
Code for training and evaluation of the model from "Language Generation with Recurrent Generative Adversarial Networks without Pre-training"
most recent commit 6 years ago
Vec4ir ⭐ 224
Word Embeddings for Information Retrieval
most recent commit 6 months ago
Germanwordembeddings ⭐ 224
Toolkit to obtain and preprocess german corpora, train models using word2vec (gensim) and evaluate them with generated testsets
most recent commit 9 months ago
Tmtoolkit ⭐ 191
Text Mining and Topic Modeling Toolkit for Python with parallel processing power
dependent packages 1total releases 33most recent commit a year agopypi tmtoolkit} Downloads
Awesome Llm Eval ⭐ 183
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, learderboard, papers, docs and models, mainly for Evaluation on LLMs.
most recent commit 3 months ago
Wefe ⭐ 169
WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!
total releases 14most recent commit 5 months ago
Mmmu ⭐ 167
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
most recent commit 3 months ago
Jury ⭐ 167
Comprehensive NLP Evaluation System
dependent packages 1total releases 23most recent commit 6 months agopypi jury} Downloads
Trustllm ⭐ 164
TrustLLM: Trustworthiness in Large Language Models
most recent commit 3 months ago
The 7 Most Depended On Natural Language Processing Evaluation Open Source Projects
Seqeval ⭐ 866
A Python framework for sequence labeling evaluation(named-entity recognition, pos tagging, etc...)
dependent packages 165total releases 24latest release October 24, 2020most recent commit a year agopypi seqeval} Downloads
Kss ⭐ 306
Kss: A Toolkit for Korean sentence segmentation
dependent packages 10total releases 84latest release January 25, 2023most recent commit 7 months agopypi kss} Downloads
Natasha ⭐ 1,085
Solves basic Russian NLP tasks, API for lower level Natasha projects
dependent packages 9total releases 19latest release July 24, 2023most recent commit 7 months agopypi natasha} Downloads
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3latest release December 08, 2022most recent commit 3 months agopypi lm-eval} Downloads
Rouge ⭐ 34
A Javascript implementation of the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) evaluation metric for summaries.
dependent packages 3total releases 4latest release December 25, 2014most recent commit 7 years agonpm rouge} Downloads
Jury ⭐ 167
Comprehensive NLP Evaluation System
dependent packages 1total releases 23latest release October 08, 2023most recent commit 6 months agopypi jury} Downloads
Tmtoolkit ⭐ 191
Text Mining and Topic Modeling Toolkit for Python with parallel processing power
dependent packages 1total releases 33latest release March 15, 2022most recent commit a year agopypi tmtoolkit} Downloads
The 10 Latest Releases In Natural Language Processing Evaluation Open Source Projects
Jury ⭐ 167
Comprehensive NLP Evaluation System
dependent packages 1total releases 23latest release October 08, 2023most recent commit 6 months agopypi jury} Downloads
Natasha ⭐ 1,085
Solves basic Russian NLP tasks, API for lower level Natasha projects
dependent packages 9total releases 19latest release July 24, 2023most recent commit 7 months agopypi natasha} Downloads
Kss ⭐ 306
Kss: A Toolkit for Korean sentence segmentation
dependent packages 10total releases 84latest release January 25, 2023most recent commit 7 months agopypi kss} Downloads
Lm Evaluation Harness ⭐ 3,768
A framework for few-shot evaluation of language models.
dependent packages 3total releases 3latest release December 08, 2022most recent commit 3 months agopypi lm-eval} Downloads
Tmtoolkit ⭐ 191
Text Mining and Topic Modeling Toolkit for Python with parallel processing power
dependent packages 1total releases 33latest release March 15, 2022most recent commit a year agopypi tmtoolkit} Downloads
Openattack ⭐ 571
An Open-Source Package for Textual Adversarial Attack.
total releases 7latest release September 22, 2021most recent commit 9 months ago
Robustness Gym ⭐ 339
Robustness Gym is an evaluation toolkit for machine learning.
total releases 8latest release August 26, 2021most recent commit 3 years ago
Seqeval ⭐ 866
A Python framework for sequence labeling evaluation(named-entity recognition, pos tagging, etc...)
dependent packages 165total releases 24latest release October 24, 2020most recent commit a year agopypi seqeval} Downloads
Popular Runtime Environments Categories
Virtualenv
Wine
Netstandard
Ipython Notebook
Nwjs
Version Manager
Pm2
Cef
Xamarin Android
Binary Analysis
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.