Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Natural Language Processing Corpus Open Source Projects

Open source projects categorized as Natural Language Processing Corpus
Categories > Machine Learning > Natural Language Processing
Nltk ⭐ 12,699
NLTK Source
dependent packages 2,261total releases 59most recent commit 3 months agopypi nltk} Downloads
Nlp_chinese_corpus ⭐ 8,344
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
most recent commit a year ago
Bert Pytorch ⭐ 5,605
Google AI 2018 BERT pytorch implementation
total releases 5most recent commit 9 months ago
Nlp Datasets ⭐ 5,235
Alphabetical list of free/public domain datasets with text data for use in Natural Language Processing (NLP)
most recent commit a year ago
Nlp_tasks ⭐ 2,904
Natural Language Processing Tasks and References
most recent commit 6 years ago
Uer Py ⭐ 2,802
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
most recent commit 5 months ago
Cluedatasetsearch ⭐ 2,778
搜索所有中文NLP数据集，附常用英文NLP数据集
most recent commit a year ago
Awesome Deeplearning Resources ⭐ 2,739
Deep Learning and deep reinforcement learning research papers and some codes
most recent commit 3 months ago
Trafilatura ⭐ 2,447
Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
dependent packages 66total releases 39most recent commit 3 months agopypi trafilatura} Downloads
Gpt2 Ml ⭐ 1,674
GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
most recent commit a year ago
Tensorflow 1.4 Billion Password Analysis ⭐ 1,657
Deep Learning model to analyze a large corpus of clear text passwords.
most recent commit 3 years ago
Chinese Annotator ⭐ 1,431
Annotator for Chinese Text Corpus (UNDER DEVELOPMENT) 中文文本标注工具
most recent commit 3 months ago
Entity Recognition Datasets ⭐ 1,386
A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.
most recent commit 6 months ago
Insuranceqa Corpus Zh ⭐ 989
🚁 保险行业语料库，聊天机器人
total releases 11most recent commit 5 months ago
Seq2seq Chatbot ⭐ 826
Chatbot in 200 lines of code using TensorLayer
most recent commit 3 years ago
Memn2n Tensorflow ⭐ 820
"End-To-End Memory Networks" in Tensorflow
most recent commit 7 years ago
Quanteda ⭐ 818
An R package for the Quantitative Analysis of Textual Data
dependent packages 46total releases 56most recent commit a month ago
Cltk ⭐ 810
The Classical Language Toolkit
dependent packages 8total releases 209most recent commit 4 months agopypi cltk} Downloads
Lingua Rs ⭐ 774
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
dependent packages 12total releases 15most recent commit 3 months agopypi lingua-language-detector} Downloads
Bookcorpus ⭐ 698
Crawl BookCorpus
most recent commit 9 months ago
Awesome Persian Nlp Ir ⭐ 658
Curated List of Persian Natural Language Processing and Information Retrieval Tools and Resources
most recent commit 7 months ago
Ekphrasis ⭐ 583
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
total releases 54most recent commit 2 years ago
Magpie ⭐ 574
Deep neural network framework for multi-label text classification
most recent commit 4 years ago
The 10 Most Depended On Natural Language Processing Corpus Open Source Projects
Nltk ⭐ 12,699
NLTK Source
dependent packages 2,261total releases 59latest release July 20, 2023most recent commit 3 months agopypi nltk} Downloads
Trafilatura ⭐ 2,447
Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
dependent packages 66total releases 39latest release November 29, 2023most recent commit 3 months agopypi trafilatura} Downloads
Quanteda ⭐ 818
An R package for the Quantitative Analysis of Textual Data
dependent packages 46total releases 56latest release May 18, 2023most recent commit a month ago
Lingua Rs ⭐ 774
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
dependent packages 12total releases 15latest release November 23, 2023most recent commit 3 months agopypi lingua-language-detector} Downloads
Nlp Corpus ⭐ 65
varied english texts for modern NLP testing
dependent packages 10total releases 20latest release June 24, 2022most recent commit 2 years agonpm nlp-corpus} Downloads
Cltk ⭐ 810
The Classical Language Toolkit
dependent packages 8total releases 209latest release November 04, 2023most recent commit 4 months agopypi cltk} Downloads
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32latest release October 23, 2023most recent commit 3 months agopypi unbabel-comet} Downloads
Hubot Natural ⭐ 121
Natural Language Processing Chatbot for RocketChat
dependent packages 2total releases 1latest release May 01, 2018most recent commit 6 years agonpm hubot-natural} Downloads
The 10 Latest Releases In Natural Language Processing Corpus Open Source Projects
Trafilatura ⭐ 2,447
Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
dependent packages 66total releases 39latest release November 29, 2023most recent commit 3 months agopypi trafilatura} Downloads
Lingua Rs ⭐ 774
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
dependent packages 12total releases 15latest release November 23, 2023most recent commit 3 months agopypi lingua-language-detector} Downloads
Insuranceqa Corpus Zh ⭐ 989
:helicopter: 保险行业语料库，聊天机器人
total releases 11latest release November 15, 2023most recent commit 5 months ago
Cltk ⭐ 810
The Classical Language Toolkit
dependent packages 8total releases 209latest release November 04, 2023most recent commit 4 months agopypi cltk} Downloads
Uniparser Grammar Udm ⭐ 11
Morphological analysis for Udmurt.
total releases 33latest release November 03, 2023most recent commit 3 months ago
Comet ⭐ 346
A Neural Framework for MT Evaluation
dependent packages 4total releases 32latest release October 23, 2023most recent commit 3 months agopypi unbabel-comet} Downloads
Opusfilter ⭐ 88
OpusFilter - Parallel corpus processing toolkit
dependent packages 1total releases 15latest release October 11, 2023most recent commit 4 months agopypi opusfilter} Downloads
Toiro ⭐ 110
A comparison tool of Japanese tokenizers
total releases 8latest release July 31, 2023most recent commit 9 months ago
Corus ⭐ 254
Links to Russian corpora + Python functions for loading and parsing
total releases 10latest release July 24, 2023most recent commit 9 months ago
Nltk ⭐ 12,699
NLTK Source
dependent packages 2,261total releases 59latest release July 20, 2023most recent commit 3 months agopypi nltk} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.