Awesome Open Source
Awesome Open Source
Combined Topics
corpus x
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210

The Top 53 Corpus Open Source Projects

Nlp_chinese_corpus ⭐ 6,023
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
Corpora ⭐ 4,051
A collection of small corpuses of interesting data for the creation of bots and similar stuff.
Chinese Names Corpus ⭐ 2,753
中文人名语料库。人名生成器。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。可用于中文分词、人名实体识别。
Awesome Deeplearning Resources ⭐ 2,379
Deep Learning and deep reinforcement learning research papers and some codes
Weibo_terminater ⭐ 2,291
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
Clue ⭐ 1,767
中文语言理解基准测评 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Awesome Chatbot ⭐ 1,687
Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:
Cluedatasetsearch ⭐ 1,627
搜索所有中文NLP数据集，附常用英文NLP数据集
Dialog_corpus ⭐ 1,575
用于训练中英文对话系统的语料库 Datasets for Training Chatbot System
Chatterbot Corpus ⭐ 975
A multilingual dialog corpus
Company Names Corpus ⭐ 873
公司名语料库。机构名语料库。公司简称,缩写,品牌词,企业名。可用于中文分词、机构名实体识别。
Insuranceqa Corpus Zh ⭐ 837
🚁 保险行业语料库，聊天机器人
Seq2seq Chatbot ⭐ 780
Chatbot in 200 lines of code using TensorLayer
Quanteda ⭐ 650
An R package for the Quantitative Analysis of Textual Data
Cluepretrainedmodels ⭐ 513
高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型
Weixin_public_corpus ⭐ 468
微信公众号语料库
Small Chinese Corpus ⭐ 465
Some useful Chinese corpus datasets 中文语料小数据
Awesome Persian Nlp Ir ⭐ 463
Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources
Chinese Nlp Corpus ⭐ 457
Collections of Chinese NLP corpus
Bookcorpus ⭐ 448
Crawl BookCorpus
Fuzzdata ⭐ 383
Fuzzing resources for feeding various fuzzers with input. 🔧
Wordless ⭐ 380
An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation
Cluecorpus2020 ⭐ 294
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
Korpora ⭐ 284
Korean corpus repository
Fakenewscorpus ⭐ 258
A dataset of millions of news articles scraped from a curated list of data sources.
Nlvr ⭐ 194
Cornell NLVR and NLVR2 are natural language grounding datasets. Each example shows a visual input and a sentence describing it, and is annotated with the truth-value of the sentence.
Efaqa Corpus Zh ⭐ 173
❤️Emotional First Aid Dataset, 心理咨询问答、聊天机器人语料库
Nlp_bahasa_resources ⭐ 168
A Curated List of Dataset and Usable Library Resources for NLP in Bahasa Indonesia
Indonesian Nlp Resources ⭐ 149
data resource untuk NLP bahasa indonesia
Wp2txt ⭐ 145
WP2TXT extracts plain text data from Wikipedia dump file (encoded in XML/compressed with Bzip2) stripping all the MediaWiki markups and other metadata.
Prosody ⭐ 143
Helsinki Prosody Corpus and A System for Predicting Prosodic Prominence from Text
Code Docstring Corpus ⭐ 139
Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.
Gossiping Chinese Corpus ⭐ 138
PTT 八卦版問答中文語料
Khcoder ⭐ 130
KH Coder: for Quantitative Content Analysis or Text Mining
Awesome Hungarian Nlp ⭐ 124
A curated list of NLP resources for Hungarian
Ua Gec ⭐ 120
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language
Sejong Corpus ⭐ 116
Korean sejong corpus download and simple analysis
Datasets ⭐ 112
Poetry-related datasets developed by THUAIPoet (Jiuge) group.
Colibri Core ⭐ 111
Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.
Pansori ⭐ 107
Tools for ASR Corpus Generation from Online Video
Pubmed Rct ⭐ 101
PubMed 200k RCT dataset: a large dataset for sequential sentence classification.
Lexicon Thai ⭐ 97
คลังศัพท์ภาษาไทย
Chi Corpus ⭐ 96
迟先生语料库
Pyclue ⭐ 92
Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
Dataset List ⭐ 84
lists of text corpus and more (mainly Japanese)
Ja.text8 ⭐ 79
Japanese text8 corpus for word embedding.
Russian_news_corpus ⭐ 76
Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ
Blacklab ⭐ 69
A corpus retrieval engine based on Apache Lucene
Coarij ⭐ 55
Corpus of Annual Reports in Japan
Mitie_chinese_wikipedia_corpus ⭐ 43
Pre-trained Wikipedia corpus by MITIE
Typing Assistant ⭐ 32
Typing Assistant provides the ability to autocomplete words and suggests predictions for the next word. This makes typing faster, more intelligent and reduces effort.
Lyrics Corpora ⭐ 13
An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts
Naive Bayes Classifier ⭐ 6
Naive Bayes classifier is classification algorithm. It uses Naive based Bernoulli and Multinomial equation to classify documents(Text) as ham or spam.
1-53 of 53 projects
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210