Awesome Open Source
Awesome Open Source
Combined Topics
corpus x

The Top 5,357 Corpus Open Source Projects

Chatterbot ⭐ 12,082
ChatterBot is a machine learning, conversational dialog engine for creating chat bots
dependent packages 10total releases 80most recent commit 3 months agopypi ChatterBot} Downloads
Nltk ⭐ 10,764
NLTK Source
dependent packages 1,324total releases 50most recent commit 3 days agopypi nltk} Downloads
Glove ⭐ 5,745
GloVe model for distributed word representation
most recent commit 4 months ago
Nlp_chinese_corpus ⭐ 5,454
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
most recent commit 2 years ago
Asrt_speechrecognition ⭐ 5,437
A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统
most recent commit 4 days ago
Tensorflow Wavenet ⭐ 4,926
A TensorFlow implementation of DeepMind's WaveNet paper
most recent commit 2 years ago
Nlp Datasets ⭐ 4,802
Alphabetical list of free/public domain datasets with text data for use in Natural Language Processing (NLP)
most recent commit 8 months ago
Corpora ⭐ 4,412
A collection of small corpuses of interesting data for the creation of bots and similar stuff.
most recent commit 14 days ago
Go Fuzz ⭐ 4,353
Randomized testing for Go
dependent packages 169total releases 3most recent commit 2 months ago
Synonyms ⭐ 4,252
🌿 中文近义词：聊天机器人，智能问答工具包
dependent packages 3total releases 41most recent commit 3 days agopypi synonyms} Downloads
Bert Pytorch ⭐ 4,189
Google AI 2018 BERT pytorch implementation
total releases 5most recent commit a year ago
Vespa ⭐ 3,942
The open big data serving engine. https://vespa.ai
dependent packages 25total releases 533most recent commit 15 hours ago
Speech To Text Wavenet ⭐ 3,586
Speech-to-Text-WaveNet : End-to-end sentence level English speech recognition based on DeepMind's WaveNet and tensorflow
most recent commit 8 months ago
Duckling ⭐ 3,512
Language, engine, and tooling for expressing, testing, and evaluating composable language rules on input strings.
total releases 9most recent commit 3 months ago
Pycorrector ⭐ 3,210
pycorrector is a toolkit for text error correction. 文本纠错，Kenlm，ConvSeq2Seq，BERT，MacBERT，ELECTRA，ERNIE，
dependent packages 1total releases 25most recent commit 5 days agopypi pycorrector} Downloads
Google 10000 English ⭐ 3,069
This repo contains a list of the 10,000 most common English words in order of frequency, as determined by n-gram frequency analysis of the Google's Trillion Word Corpus.
most recent commit 5 months ago
Chinese Names Corpus ⭐ 3,008
中文人名语料库。人名生成器。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。可用于中文分词
most recent commit 6 months ago
Laser ⭐ 3,001
Language-Agnostic SEntence Representations
most recent commit 11 days ago
Markovify ⭐ 2,976
A simple, extensible Markov chain generator.
dependent packages 29total releases 36most recent commit 2 months agopypi markovify} Downloads
Nlp_tasks ⭐ 2,904
Natural Language Processing Tasks and References
most recent commit 4 years ago
Deepqa ⭐ 2,839
My tensorflow implementation of "A neural conversational model", a Deep learning based chatbot
most recent commit 24 days ago
Clue ⭐ 2,671
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
most recent commit 17 days ago
Awesome Deeplearning Resources ⭐ 2,532
Deep Learning and deep reinforcement learning research papers and some codes
most recent commit 3 months ago
Cluedatasetsearch ⭐ 2,336
搜索所有中文NLP数据集，附常用英文NLP数据集
most recent commit 2 months ago
Chinese_chatbot_corpus ⭐ 2,326
中文公开聊天语料库
most recent commit 10 months ago
Weibo_terminater ⭐ 2,265
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
most recent commit 3 years ago
Uer Py ⭐ 2,084
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
most recent commit 19 hours ago
Tensorflow 1.4 Billion Password Analysis ⭐ 1,657
Deep Learning model to analyze a large corpus of clear text passwords.
most recent commit a year ago
Awesome Chatbot ⭐ 1,556
Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:
most recent commit 2 years ago
Chatbot Retrieval ⭐ 1,545
Dual LSTM Encoder for Dialog Response Generation
most recent commit 9 months ago
Dialog_corpus ⭐ 1,487
用于训练中英文对话系统的语料库 Datasets for Training Chatbot System
most recent commit 2 years ago
Fuzzilli ⭐ 1,417
A JavaScript Engine Fuzzer
most recent commit 2 months ago
Rasa_nlu_chi ⭐ 1,335
Turn Chinese natural language into structured data 中文自然语言理解
most recent commit a day ago
Chinese Annotator ⭐ 1,309
Annotator for Chinese Text Corpus (UNDER DEVELOPMENT) 中文文本标注工具
most recent commit a month ago
Gpt2 Ml ⭐ 1,223
GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
most recent commit 9 months ago
Rc Data ⭐ 1,221
Question answering dataset featured in "Teaching Machines to Read and Comprehend
most recent commit 5 years ago
Glove Python ⭐ 1,171
Toy Python implementation of http://www-nlp.stanford.edu/projects/glove/
dependent packages 3total releases 1most recent commit 3 months agopypi glove_python} Downloads
Entity Recognition Datasets ⭐ 1,162
A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.
most recent commit 18 hours ago
Chatterbot Corpus ⭐ 1,124
A multilingual dialog corpus
dependent packages 1total releases 1most recent commit 3 months agopypi sugaroid-chatterbot-corpus} Downloads
Yake ⭐ 994
Single-document unsupervised keyword extraction
total releases 2most recent commit 3 months ago
Autophrase ⭐ 978
AutoPhrase: Automated Phrase Mining from Massive Text Corpora
total releases 3most recent commit 4 months ago
Cdial Gpt ⭐ 910
A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
most recent commit a month ago
Insuranceqa Corpus Zh ⭐ 897
🚁 保险行业语料库，聊天机器人
total releases 8most recent commit 7 days ago
Company Names Corpus ⭐ 891
公司名语料库。机构名语料库。公司简称,缩写,品牌词,企业名。可用于中文分词、机构名实体识别。
most recent commit a year ago
Nlp Datasets ⭐ 871
A list of datasets/corpora for NLP tasks, in reverse chronological order.
most recent commit 2 years ago
Voice_datasets ⭐ 846
🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).
most recent commit 3 months ago
Memn2n Tensorflow ⭐ 820
"End-To-End Memory Networks" in Tensorflow
most recent commit 5 years ago
Seq2seq Chatbot ⭐ 788
Chatbot in 200 lines of code using TensorLayer
most recent commit 3 years ago
Chinese_medical_nlp ⭐ 772
中文医疗NLP领域 数据集，论文 ，知识图谱，语料，工具包
most recent commit 9 months ago
Quanteda ⭐ 718
An R package for the Quantitative Analysis of Textual Data
dependent packages 41total releases 51most recent commit a month ago
Cltk ⭐ 718
The Classical Language Toolkit
dependent packages 8total releases 197most recent commit a month agopypi cltk} Downloads
Lexvec ⭐ 700
This is an implementation of the LexVec word embedding model (similar to word2vec and GloVe) that achieves state of the art results in multiple NLP tasks
total releases 5most recent commit a year ago
Ngram2vec ⭐ 638
Four word embedding models implemented in Python. Supporting arbitrary context features
most recent commit 3 years ago
Wiki2vec ⭐ 587
Generating Vectors for DBpedia Entities via Word2Vec and Wikipedia Dumps. Questions? https://gitter.im/idio-opensource/Lobby
most recent commit 4 years ago
Pisa ⭐ 584
PISA: Performant Indexes and Search for Academia
most recent commit 2 months ago
Magpie ⭐ 574
Deep neural network framework for multi-label text classification
most recent commit 2 years ago
Bytenet ⭐ 570
A tensorflow implementation of French-to-English machine translation using DeepMind's ByteNet .
most recent commit 8 months ago
Ubuntu Ranking Dataset Creator ⭐ 570
A script that creates train, valid and test datasets for the ranking task from Ubuntu corpus dialogs.
most recent commit 5 years ago
Afl ⭐ 558
american fuzzy lop (copy of the source code for easy access)
most recent commit 5 years ago
Awesome Persian Nlp Ir ⭐ 557
Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources
most recent commit 12 hours ago
Ekphrasis ⭐ 554
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
total releases 54most recent commit 11 days ago
Jsfuzz ⭐ 537
coverage guided fuzz testing for javascript
dependent packages 4total releases 16most recent commit a year agonpm jsfuzz} Downloads
Cluepretrainedmodels ⭐ 536
高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型
most recent commit 2 years ago
Bookcorpus ⭐ 536
Crawl BookCorpus
most recent commit 2 months ago
Multiturnresponseselection ⭐ 534
This repo contains our ACL 2017 paper data and source code
most recent commit 2 years ago
Ner Lstm ⭐ 528
Named Entity Recognition using multilayered bidirectional LSTM
most recent commit 3 years ago
Lingua Rs ⭐ 518
👄 The most accurate natural language detection library for Rust, suitable for long and short text alike
dependent packages 1total releases 3most recent commit 3 days agocargo lingua-latvian-language-model} Downloads
Wordless ⭐ 505
An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation
most recent commit a month ago
Awesome Korean Nlp ⭐ 495
A curated list of resources for NLP (Natural Language Processing) for Korean
most recent commit 2 years ago
Gensim Data ⭐ 492
Data repository for pretrained NLP models and NLP corpora.
most recent commit 4 years ago
Language Style Transfer ⭐ 491
most recent commit a year ago
Trafilatura ⭐ 473
Web scraping library and command-line tool for text discovery and extraction (main content, metadata, comments)
dependent packages 4total releases 29most recent commit 10 days agopypi trafilatura} Downloads
Deta_parser ⭐ 472
快速中文分词分析word segmentation
most recent commit 3 months ago
Commoncrawl ⭐ 466
Common Crawl support library to access 2008-2012 crawl archives (ARC files)
most recent commit 4 years ago
Ba Dls Deepspeech ⭐ 457
most recent commit 4 years ago
Bertweet ⭐ 445
BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)
most recent commit 5 days ago
Markov ⭐ 441
Markov chain text generator, as used for KingJamesProgramming
most recent commit 6 years ago
Document_cluster ⭐ 440
A guide to document clustering in Python
most recent commit 3 years ago
Tabert ⭐ 436
This repository contains source code for the TaBERT model, a pre-trained language model for learning joint representations of natural language utterances and (semi-)structured tables for semantic parsing. TaBERT is pre-trained on a massive corpus of 26M Web tables and their associated natural language context, and could be used as a drop-in replacement of a semantic parsers original encoder to compute representations for utterances and table schemas (columns).
most recent commit 10 months ago
Corpus ⭐ 436
Yet another CSS toolkit. Basically the stuff I use for most projects.
most recent commit 6 years ago
Chinesewordsegmentation ⭐ 427
Chinese word segmentation algorithm without corpus（无需语料库的中文分词）
most recent commit 2 years ago
Awesome Bangla ⭐ 423
A collection of tools, datasets and resources on Bangla computing
most recent commit 24 days ago
Undreamt ⭐ 421
Unsupervised Neural Machine Translation
most recent commit 2 years ago
Fact Extractor ⭐ 413
Fact Extraction from Wikipedia Text
most recent commit 6 years ago
Exbert ⭐ 408
A Visual Analysis Tool to Explore Learned Representations in Transformers Models
most recent commit a year ago
Paws ⭐ 403
This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.
most recent commit 5 months ago
Korpora ⭐ 401
Korean corpus repository
dependent packages 1total releases 7most recent commit 5 months agopypi Korpora} Downloads
Cec Corpus ⭐ 399
📚中文突发事件语料库（Chinese Emergency Corpus）-上海大学-语义智能实验室
most recent commit 3 years ago
Corpus ⭐ 396
自然语言处理，知识图谱相关语料。按照Task细分，欢迎PR。
most recent commit a year ago
Fuzzdata ⭐ 389
Fuzzing resources for feeding various fuzzers with input. 🔧
most recent commit a year ago
Text_renderer ⭐ 381
most recent commit 2 months ago
Insuranceqa ⭐ 379
A question answering corpus in insurance domain
most recent commit 5 years ago
Chinese Nlp Corpus ⭐ 378
Collections of Chinese NLP corpus
most recent commit a year ago
Afl Utils ⭐ 377
Utilities for automated crash sample processing/analysis, easy afl-fuzz job management and corpus optimization
most recent commit 4 years ago
Fast_align ⭐ 377
Simple, fast unsupervised word aligner
most recent commit 2 years ago
Cpu_rec ⭐ 373
Recognize cpu instructions in an arbitrary binary file
most recent commit a year ago
S2orc ⭐ 364
S2ORC: The Semantic Scholar Open Research Corpus: https://www.aclweb.org/anthology/2020.acl-main.447
most recent commit 9 days ago
Chinesenlpcorpus ⭐ 362
An collection of Chinese nlp corpus including basic Chinese syntatic wordset, semantic wordset, historic corpus and evaluate corpus. 中文自然语言处理的语料集合，包括语义词、领域共时、历时语料库、评测语料库等。
most recent commit 3 years ago
Azureml Bert ⭐ 354
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
most recent commit 6 months ago
Atap ⭐ 349
Code for Applied Text Analysis with Python
most recent commit 15 days ago
1-100 of 5,357 projects
Related Awesome Lists
Python Corpus Projects (2,457)
Nlp Corpus Projects (510)
Jupyter Notebook Corpus Projects (471)
Text Corpus Projects (426)
Dataset Corpus Projects (342)
Java Corpus Projects (308)
Language Corpus Projects (260)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,049,307)
Python  (796,774)
Java  (385,554)
Php  (284,659)
Typescript  (240,091)
C Plus Plus  (236,336)
Ruby  (221,670)
C  (180,445)
Shell  (169,696)
C Sharp  (162,146)
Golang  (156,215)
Swift  (64,723)
R  (57,307)
Objective C  (57,160)
Rust  (56,175)
Dart  (51,536)
Kotlin  (45,555)
Lua  (33,316)
Matlab  (30,910)
Perl  (30,480)
Language  (30,081)
Scala  (28,595)
Haskell  (20,266)
Clojure  (19,073)
Powershell  (18,808)
Bash  (18,609)
Coffeescript  (17,327)
Elixir  (16,573)
Assembly  (14,535)
Processing  (13,303)
Julia  (12,548)
Basic  (10,762)
Flow  (10,527)
Emacs Lisp  (10,374)
Erlang  (9,056)
Scheme  (8,438)
Groovy  (8,433)
Solidity  (7,630)
Ocaml  (6,669)
Pascal  (6,384)
Hack  (6,366)
Lisp  (6,340)
Fortran  (5,485)
Elm  (5,478)
Common Lisp  (5,278)
Dlang  (4,745)
Shell Script  (4,633)
Python Library  (4,449)
Crystal  (4,375)
Scripting  (4,203)
Top Projects
Freecodecamp ⭐ 346,483
996.icu ⭐ 262,320
Free Programming Books ⭐ 233,869
Coding Interview University ⭐ 220,499
Awesome ⭐ 202,760
Vue ⭐ 196,227
Developer Roadmap ⭐ 195,459
Public Apis ⭐ 194,093
React ⭐ 188,524
System Design Primer ⭐ 180,789
Tensorflow ⭐ 165,263
Bootstrap ⭐ 157,530
You Dont Know Js ⭐ 153,649
Cs Notes ⭐ 150,780
Ohmyzsh ⭐ 145,579
Build Your Own X ⭐ 142,363
Javascript Algorithms ⭐ 141,923
Flutter ⭐ 140,992
Python ⭐ 136,366
Gitignore ⭐ 133,520
Linux ⭐ 132,253
Vscode ⭐ 132,135
Awesome Python ⭐ 127,528
Javascript ⭐ 123,498
Javaguide ⭐ 121,716
Python 100 Days ⭐ 117,585
Computer Science ⭐ 113,544
Youtube Dl ⭐ 110,286
Fucking Algorithm ⭐ 106,048
The Art Of Command Line ⭐ 105,874
React Native ⭐ 102,897
Electron ⭐ 101,831
D3 ⭐ 100,901
Go ⭐ 99,557
30 Seconds Of Code ⭐ 95,885
Create React App ⭐ 95,200
Axios ⭐ 93,611
Awesome Selfhosted ⭐ 89,230
Kubernetes ⭐ 88,745
Free Programming Books Zh_cn ⭐ 88,386
Node ⭐ 87,866
Next.js ⭐ 87,217
Terminal ⭐ 83,297
Deno ⭐ 82,633
Three.js ⭐ 82,255
Angular ⭐ 81,550
Awesome Go ⭐ 81,188
Typescript ⭐ 80,934
Ant Design ⭐ 80,442
Material Ui ⭐ 78,665
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.