Awesome Open Source

Programming Languages

The Top 23 Text Corpus Open Source Projects

Open source projects categorized as Text Corpus

Categories > Data Processing > Corpus

Categories > Text Processing > Text

Markovify ⭐ 3,168

A simple, extensible Markov chain generator.

dependent packages 31total releases 36most recent commit a year ago

pypi markovify} Downloads

Trafilatura ⭐ 2,447

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

dependent packages 66total releases 39most recent commit 3 months ago

pypi trafilatura} Downloads

Tensorflow 1.4 Billion Password Analysis ⭐ 1,657

Deep Learning model to analyze a large corpus of clear text passwords.

most recent commit 3 years ago

Single-document unsupervised keyword extraction

total releases 2most recent commit 4 months ago

Bookcorpus ⭐ 698

Crawl BookCorpus

most recent commit 10 months ago

Ekphrasis ⭐ 583

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

total releases 54most recent commit 2 years ago

Deep neural network framework for multi-label text classification

most recent commit 4 years ago

Text_renderer ⭐ 543

most recent commit a year ago

Markov chain text generator, as used for KingJamesProgramming

most recent commit 8 years ago

Fact Extractor ⭐ 413

Fact Extraction from Wikipedia Text

most recent commit 8 years ago

Code for Applied Text Analysis with Python

most recent commit a year ago

Khcoder ⭐ 295

KH Coder: for Quantitative Content Analysis or Text Mining

most recent commit 4 months ago

Nlg Yongzhuo ⭐ 273

中文文本生成（NLG）之文本摘要（text summarization）工具包, 语料数据(corpus data), 抽取式摘要 Extractive text summary of Lead3、keyword、textrank、text teaser、word significance、LDA、LSI、NMF。（graph，feature，topic model，summarize tool or tookit）

dependent packages 1total releases 3most recent commit 2 years ago

pypi nlg-yongzhuo} Downloads

Parsbert ⭐ 222

🤗 ParsBERT: Transformer-based Model for Persian Language Understanding

most recent commit a year ago

Seq2seqsharp ⭐ 188

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

dependent packages 3total releases 1most recent commit 4 months ago

nuget AdvUtils} Downloads

Tweet Secret ⭐ 181

This is a text steganography application optimized for use on Twitter, written in Clojure.

most recent commit 11 years ago

Awesome Nlp Polish ⭐ 169

A curated list of resources dedicated to Natural Language Processing (NLP) in polish. Models, tools, datasets.

most recent commit 3 years ago

A command-line toolkit to extract text content and category data from Wikipedia dump files

total releases 29most recent commit a year ago

Wiki2text ⭐ 129

Extract a plain text corpus from MediaWiki XML dumps, such as Wikipedia.

most recent commit 5 years ago

Word2vec Lucene ⭐ 127

This tool extracts word vectors from Lucene index.

most recent commit 6 years ago

Pyquran ⭐ 123

PyQuran: The Python package for Quranic Analysis https://hci-lab.github.io/PyQuran-Private

total releases 2most recent commit a year ago

Kanji Frequency ⭐ 116

Kanji usage frequency data collected from various sources

most recent commit 4 months ago

Readtext ⭐ 112

an R package for reading text files

dependent packages 4total releases 10most recent commit 4 months ago

The 10 Most Depended On Text Corpus Open Source Projects

Trafilatura ⭐ 2,447

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

dependent packages 66total releases 39latest release November 29, 2023most recent commit 3 months ago

pypi trafilatura} Downloads

Markovify ⭐ 3,168

A simple, extensible Markov chain generator.

dependent packages 31total releases 36latest release March 03, 2022most recent commit a year ago

pypi markovify} Downloads

Readtext ⭐ 112

an R package for reading text files

dependent packages 4total releases 10latest release June 03, 2023most recent commit 4 months ago

Infatuate ⭐ 8

Generates random samples of text from a given corpus.

dependent packages 3total releases 1latest release May 20, 2013most recent commit 11 years ago

npm infatuate} Downloads

Seq2seqsharp ⭐ 188

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

dependent packages 3total releases 1latest release May 09, 2022most recent commit 4 months ago

nuget AdvUtils} Downloads

Node Markov Generator ⭐ 8

Generates simple sentences based on given text corpus

dependent packages 2total releases 9latest release August 18, 2020most recent commit 2 years ago

npm node-markov-generator} Downloads

Annotate data from brat offline painlessly

dependent packages 2total releases 6latest release October 28, 2015most recent commit 9 years ago

npm brat} Downloads

Corpustools ⭐ 26

An R corpus class for tokenized texts

dependent packages 2total releases 12latest release May 11, 2022most recent commit a year ago

Nlg Yongzhuo ⭐ 273

中文文本生成（NLG）之文本摘要（text summarization）工具包, 语料数据(corpus data), 抽取式摘要 Extractive text summary of Lead3、keyword、textrank、text teaser、word significance、LDA、LSI、NMF。（graph，feature，topic model，summarize tool or tookit）

dependent packages 1total releases 3latest release May 14, 2020most recent commit 2 years ago

pypi nlg-yongzhuo} Downloads

🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, JSON, SQLite, VTT, Audacity, TTL, TIG, ISF, etc.)

dependent packages 1total releases 17latest release March 17, 2022most recent commit 2 years ago

pypi speach} Downloads

The 10 Latest Releases In Text Corpus Open Source Projects

Trafilatura ⭐ 2,447

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

dependent packages 66total releases 39latest release November 29, 2023most recent commit 3 months ago

pypi trafilatura} Downloads

Tool for performing basic text analysis on the CBETA corpus

dependent packages 1total releases 26latest release September 06, 2023most recent commit 8 months ago

pypi tacl} Downloads

Readtext ⭐ 112

an R package for reading text files

dependent packages 4total releases 10latest release June 03, 2023most recent commit 4 months ago

A command-line toolkit to extract text content and category data from Wikipedia dump files

total releases 29latest release May 13, 2023most recent commit a year ago

Textdirectory ⭐ 7

TextDirectory allows you to filter, transform, and combine multiple text files into one aggregated file.

total releases 12latest release September 25, 2022most recent commit 2 years ago

Corporaexplorer ⭐ 62

An R package for dynamic exploration of text collections

total releases 11latest release June 20, 2022most recent commit 10 months ago

Ekphrasis ⭐ 583

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

total releases 54latest release May 17, 2022most recent commit 2 years ago

Corpustools ⭐ 26

An R corpus class for tokenized texts

dependent packages 2total releases 12latest release May 11, 2022most recent commit a year ago

Seq2seqsharp ⭐ 188

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

dependent packages 3total releases 1latest release May 09, 2022most recent commit 4 months ago

nuget AdvUtils} Downloads

🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, JSON, SQLite, VTT, Audacity, TTL, TIG, ISF, etc.)

dependent packages 1total releases 17latest release March 17, 2022most recent commit 2 years ago

pypi speach} Downloads

Popular Data Processing Categories

Jupyter Notebook

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.