Unidic2ud

Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japanese
Alternatives To Unidic2ud
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Kagome769273 months ago74September 27, 20234mitGo
Self-contained Japanese Morphological Analyzer written in pure Go
Bert Japanese415
3 years agoapache-2.0Jupyter Notebook
BERT with SentencePiece for Japanese text.
Nagisa365173 months ago22July 30, 20234mitPython
A Japanese tokenizer based on recurrent neural networks
Fugashi339393 months ago67August 25, 20235mitC++
A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
Jumanpp334
a year ago30apache-2.0C++
Juman++ (a Morphological Analyzer Toolkit)
Sudachipy318
2 years ago18apache-2.0Python
Python version of Sudachi, a Japanese tokenizer.
Vibrato27514 months ago11May 12, 20233apache-2.0Rust
🎤 vibrato: Viterbi-based accelerated tokenizer
Vaporetto20635 months ago16April 01, 2023apache-2.0Rust
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
Konoha20013 months ago10August 03, 2022mitPython
🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
Toiro110
9 months ago8July 31, 20231apache-2.0Python
A comparison tool of Japanese tokenizers
Alternatives To Unidic2ud
Select To Compare


Alternative Project Comparisons
Popular Japanese Projects
Popular Tokenizer Projects
Popular Community Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Natural Language Processing
Japanese
Pos
Tokenizer
Spacy