Glue X
We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that the OOD accuracy in NLP tasks needs to be paid more attention to since the significant performance decay compared to ID accuracy has been found in all settings.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Nlp_chinese_corpus | 8,344 | a year ago | 20 | mit | ||||||
| 大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP | ||||||||||
| Baichuan2 | 3,527 | 5 months ago | 231 | apache-2.0 | Python | |||||
| A series of large language models developed by Baichuan Intelligent Technology | ||||||||||
| Baichuan 13b | 2,579 | 10 months ago | 76 | apache-2.0 | Python | |||||
| A 13B large language model developed by Baichuan Intelligent Technology | ||||||||||
| Deepmoji | 1,462 | 9 months ago | 10 | mit | Python | |||||
| State-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc. | ||||||||||
| Beir | 1,411 |  | 8 | 3 months ago | 29 | July 21, 2023 | 57 | apache-2.0 | Python | |
| A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets. | ||||||||||
| Torchmoji | 882 | a year ago | 21 | mit | Python | |||||
| 😇A pyTorch implementation of the DeepMoji model: state-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc | ||||||||||
| Bolt | 823 | a year ago | 38 | mit | C++ | |||||
| Bolt is a deep learning library with high performance and heterogeneous flexibility. | ||||||||||
| Long Range Arena | 635 | 6 months ago | 27 | apache-2.0 | Python | |||||
| Long Range Arena for Benchmarking Efficient Transformers | ||||||||||
| Fastrag | 591 | 5 months ago | 1 | apache-2.0 | Python | |||||
| Efficient Retrieval Augmentation and Generation Framework | ||||||||||
| Indonlu | 518 | 2 years ago | 5 | apache-2.0 | Jupyter Notebook | |||||
| The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020) | ||||||||||
Alternatives To Glue XSelect To Compare
Alternative Project Comparisons
Popular Natural Language Processing Projects
Popular Benchmark Projects
Popular Machine Learning Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Natural Language Processing
Benchmark