Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Dataset Natural Language Processing Open Source Projects

Open source projects categorized as Dataset Natural Language Processing
Categories > Data Processing > Dataset
Categories > Machine Learning > Natural Language Processing
Datasets ⭐ 18,319
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
dependent packages 760total releases 76most recent commit 10 days agopypi datasets} Downloads
Doccano ⭐ 8,927
Open source annotation tool for machine learning practitioners.
total releases 32most recent commit a month ago
Nlp_chinese_corpus ⭐ 8,344
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
most recent commit a year ago
Awesome Pretrained Chinese Nlp Models ⭐ 3,738
Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合
most recent commit 3 months ago
Text ⭐ 3,411
Models, data loaders and abstractions for language processing, powered by PyTorch
dependent packages 146total releases 29most recent commit 3 months agopypi torchtext} Downloads
Cluedatasetsearch ⭐ 2,778
搜索所有中文NLP数据集，附常用英文NLP数据集
most recent commit a year ago
Textattack ⭐ 2,597
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
dependent packages 5total releases 46most recent commit 4 months agopypi textattack} Downloads
Pytorch Nlp ⭐ 2,180
Basic Utilities for PyTorch Natural Language Processing (NLP)
dependent packages 10total releases 19most recent commit 9 months agopypi pytorch-nlp} Downloads
Codesearchnet ⭐ 2,054
Datasets, tools, and benchmarks for representation learning of code.
most recent commit 2 years ago
Medical_nlp ⭐ 1,970
Medical NLP Competition, dataset, large models, paper 医疗NLP领域 比赛，数据集，大模型，论文，工具包
most recent commit a month ago
Awesome_chinese_medical_nlp ⭐ 1,847
中文医学NLP公开资源整理：术语集/语料库/词向量/预训练模型/知识图谱/命名实体识别/QA/信息抽
most recent commit 3 months ago
Chineseglue ⭐ 1,765
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
most recent commit a year ago
Awesome Domain Llm ⭐ 1,502
收集和梳理垂直领域的开源模型、数据集及评测基准。
most recent commit 4 months ago
Transfer Learning Conv Ai ⭐ 1,499
🦄 State-of-the-Art Conversational AI with Transfer Learning
most recent commit a year ago
Deepmoji ⭐ 1,462
State-of-the-art deep learning model for analyzing sentiment, emotion, sarcasm etc.
most recent commit 7 months ago
Entity Recognition Datasets ⭐ 1,386
A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.
most recent commit 6 months ago
Wikisql ⭐ 1,370
A large annotated semantic parsing corpus for developing natural language interfaces.
most recent commit 9 months ago
Beir ⭐ 1,332
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
dependent packages 8total releases 29most recent commit a month agopypi beir} Downloads
Chinesenlp ⭐ 1,329
Datasets, SOTA results of every fields of Chinese NLP
most recent commit 3 years ago
Dataprofiler ⭐ 1,310
What's in your data? Extract schema, statistics and entities from datasets
dependent packages 3total releases 53most recent commit 3 months agopypi DataProfiler} Downloads
Projects ⭐ 1,207
🪐 End-to-end NLP workflows from prototype to production
most recent commit 3 months ago
Data Juicer ⭐ 994
A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！
total releases 3most recent commit 3 months ago
Insuranceqa Corpus Zh ⭐ 989
🚁 保险行业语料库，聊天机器人
total releases 11most recent commit 5 months ago
The 10 Most Depended On Dataset Natural Language Processing Open Source Projects
Datasets ⭐ 18,319
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
dependent packages 760total releases 76latest release November 16, 2023most recent commit 10 days agopypi datasets} Downloads
Text ⭐ 3,411
Models, data loaders and abstractions for language processing, powered by PyTorch
dependent packages 146total releases 29latest release November 15, 2023most recent commit 3 months agopypi torchtext} Downloads
Pytorch Nlp ⭐ 2,180
Basic Utilities for PyTorch Natural Language Processing (NLP)
dependent packages 10total releases 19latest release November 04, 2019most recent commit 9 months agopypi pytorch-nlp} Downloads
Beir ⭐ 1,332
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
dependent packages 8total releases 29latest release July 21, 2023most recent commit a month agopypi beir} Downloads
Chatito ⭐ 755
🎯🗯 Generate datasets for AI chatbots, NLP tasks, named entity recognition or text classification models using a simple DSL!
dependent packages 5total releases 29latest release October 03, 2019most recent commit 2 years agonpm chatito} Downloads
Danlp ⭐ 141
DaNLP is a repository for Natural Language Processing resources for the Danish Language.
dependent packages 5total releases 14latest release February 17, 2022most recent commit 2 years agopypi danlp} Downloads
Navec ⭐ 140
Compact high quality word embeddings for Russian language
dependent packages 4total releases 9latest release October 29, 2020most recent commit 9 months agopypi navec} Downloads
Dataprofiler ⭐ 1,310
What's in your data? Extract schema, statistics and entities from datasets
dependent packages 3total releases 53latest release November 14, 2023most recent commit 3 months agopypi DataProfiler} Downloads
Pytreebank ⭐ 83
:rage::innocent: Stanford Sentiment Treebank loader in Python
dependent packages 3total releases 21latest release February 18, 2020most recent commit 4 years agopypi pytreebank} Downloads
The 10 Latest Releases In Dataset Natural Language Processing Open Source Projects
Datasets ⭐ 18,319
🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
dependent packages 760total releases 76latest release November 16, 2023most recent commit 10 days agopypi datasets} Downloads
Text ⭐ 3,411
Models, data loaders and abstractions for language processing, powered by PyTorch
dependent packages 146total releases 29latest release November 15, 2023most recent commit 3 months agopypi torchtext} Downloads
Insuranceqa Corpus Zh ⭐ 989
:helicopter: 保险行业语料库，聊天机器人
total releases 11latest release November 15, 2023most recent commit 5 months ago
Dataprofiler ⭐ 1,310
What's in your data? Extract schema, statistics and entities from datasets
dependent packages 3total releases 53latest release November 14, 2023most recent commit 3 months agopypi DataProfiler} Downloads
Cli ⭐ 15
Command line interface for Re:infer and Rust client library
dependent packages 1total releases 37latest release November 08, 2023most recent commit 3 months agocargo reinfer-client} Downloads
Tasknet ⭐ 30
Easy multi-task learning with HuggingFace Datasets and Trainer
total releases 55latest release November 02, 2023most recent commit 3 months ago
Ua Datasets ⭐ 44
A collection of datasets for Ukrainian language
total releases 18latest release October 18, 2023most recent commit 6 months ago
Jury ⭐ 167
Comprehensive NLP Evaluation System
dependent packages 1total releases 23latest release October 08, 2023most recent commit 6 months agopypi jury} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.