Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Kotori

A Japanese tokenizer and morphological analysis engine written in Kotlin
Stars
15
License
mit
Open Issues
0
Most Recent Commit
4 years ago
Programming Language
Kotlin
Categories
Repo
Alternatives To Kotori
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Kagome769275 months ago74September 27, 20234mitGo
Self-contained Japanese Morphological Analyzer written in pure Go
Bert Japanese415
3 years agoapache-2.0Jupyter Notebook
BERT with SentencePiece for Japanese text.
Nagisa365pypi nagisa} Downloads176 months ago22July 30, 20234mitPython
A Japanese tokenizer based on recurrent neural networks
Fugashi339pypi fugashi} Downloads396 months ago67August 25, 20235mitC++
A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
Jumanpp334
a year ago30apache-2.0C++
Juman++ (a Morphological Analyzer Toolkit)
Sudachipy318
2 years ago18apache-2.0Python
Python version of Sudachi, a Japanese tokenizer.
Vibrato275cargo vibrato} Downloads16 months ago11May 12, 20233apache-2.0Rust
🎤 vibrato: Viterbi-based accelerated tokenizer
Vaporetto206cargo vaporetto} Downloads38 months ago16April 01, 2023apache-2.0Rust
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
Konoha20015 months ago10August 03, 2022mitPython
🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
Toiro110
a year ago8July 31, 20231apache-2.0Python
A comparison tool of Japanese tokenizers
Alternatives To Kotori
Select To Compare
Kagome ⭐ 769
Self-contained Japanese Morphological Analyzer written in pure Go
dependent packages 27total releases 74most recent commit 5 months ago
Nagisa ⭐ 365
A Japanese tokenizer based on recurrent neural networks
dependent packages 7total releases 22most recent commit 6 months agopypi nagisa} Downloads
Vibrato ⭐ 275
🎤 vibrato: Viterbi-based accelerated tokenizer
dependent packages 1total releases 11most recent commit 6 months agocargo vibrato} Downloads
Vaporetto ⭐ 206
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
dependent packages 3total releases 16most recent commit 8 months agocargo vaporetto} Downloads
Toiro ⭐ 110
A comparison tool of Japanese tokenizers
total releases 8most recent commit a year ago


Suggest An Alternative To kotori
Alternative Project Comparisons
Kotori vs Kagome
Kotori vs Bert Japanese
Kotori vs Nagisa
Kotori vs Fugashi
Kotori vs Jumanpp
Kotori vs Sudachipy
Kotori vs Vibrato
Kotori vs Vaporetto
Kotori vs Konoha
Kotori vs Toiro
Popular Tokenizer Projects
Sentencepiece ⭐ 8,851
Unsupervised text tokenizer for Neural Network-based text generation.
dependent packages 787total releases 34latest release May 02, 2023most recent commit 5 months agopypi sentencepiece} Downloads
Tokenizers ⭐ 8,056
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
dependent packages 362total releases 85latest release November 14, 2023most recent commit 5 months agopypi tokenizers} Downloads
Php Token Stream ⭐ 6,457
Wrapper around PHP's tokenizer extension.
dependent packages 188total releases 36latest release November 30, 2020most recent commit 3 years agopackagist phpunit/php-token-stream} Downloads
Tokenizer ⭐ 5,084
A small library for converting tokenized PHP source code into XML (and potentially other formats)
dependent packages 11total releases 8latest release November 20, 2023most recent commit 7 months agopackagist theseer/tokenizer} Downloads
Popular Japanese Projects
Nes.css ⭐ 20,093
NES-style CSS Framework | ファミコン風CSSフレームワーク
dependent packages 15total releases 9latest release December 17, 2019most recent commit 6 months agonpm nes.css} Downloads
Popular Compilers Categories
Llvm
Abstract Syntax Tree
Gcc
Clang
Emscripten
Wsl
Lexer
Jit
Ghc
Ida

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Kotlin
Benchmark
Japanese
Tokenizer
Trie
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.