Japanesetokenizers

aim to use JapaneseTokenizer as easy as possible
Alternatives To Japanesetokenizers
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Gse2,35214214 months ago82January 16, 202312apache-2.0Go
Go efficient multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
Scattertext2,131827 months ago148April 18, 202322apache-2.0Python
Beautiful visualizations of how language differs among document types.
Budou1,135
1a year ago36November 07, 20196apache-2.0Python
Budou is an automatic organizer tool for beautiful line breaking in CJK (Chinese, Japanese, and Korean).
Ginza676126 months ago19September 25, 202311mitPython
A Japanese NLP Library using spaCy as framework based on Universal Dependencies
Awesome Japanese Nlp Resources522
2 months agocc0-1.0
A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese
Japanese Pretrained Models479
a year ago3apache-2.0Python
Code for producing Japanese pretrained models provided by rinna Co., Ltd.
Nagisa365172 months ago22July 30, 20234mitPython
A Japanese tokenizer based on recurrent neural networks
Pykakasi34911182 years ago49April 14, 20221gpl-3.0Python
Lightweight converter from Japanese Kana-kanji sentences into Kana-Roman.
Fugashi339393 months ago67August 25, 20235mitC++
A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
Jumanpp334
a year ago30apache-2.0C++
Juman++ (a Morphological Analyzer Toolkit)
Alternatives To Japanesetokenizers
Select To Compare


Alternative Project Comparisons
Popular Natural Language Processing Projects
Popular Japanese Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Natural Language Processing
Japanese
Tokenizer