Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Aws Lambda Ja Tokenizer

Japanese tokenizer for AWS Lambda
Stars
14
License
mit
Open Issues
0
Most Recent Commit
7 years ago
Programming Language
Python
Categories
Repo
Alternatives To Aws Lambda Ja Tokenizer
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Kagome769274 months ago74September 27, 20234mitGo
Self-contained Japanese Morphological Analyzer written in pure Go
Bert Japanese415
3 years agoapache-2.0Jupyter Notebook
BERT with SentencePiece for Japanese text.
Nagisa365pypi nagisa} Downloads174 months ago22July 30, 20234mitPython
A Japanese tokenizer based on recurrent neural networks
Fugashi339pypi fugashi} Downloads394 months ago67August 25, 20235mitC++
A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
Jumanpp334
a year ago30apache-2.0C++
Juman++ (a Morphological Analyzer Toolkit)
Sudachipy318
2 years ago18apache-2.0Python
Python version of Sudachi, a Japanese tokenizer.
Vibrato275cargo vibrato} Downloads15 months ago11May 12, 20233apache-2.0Rust
🎤 vibrato: Viterbi-based accelerated tokenizer
Vaporetto206cargo vaporetto} Downloads36 months ago16April 01, 2023apache-2.0Rust
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
Konoha20014 months ago10August 03, 2022mitPython
🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
Toiro110
10 months ago8July 31, 20231apache-2.0Python
A comparison tool of Japanese tokenizers
Alternatives To Aws Lambda Ja Tokenizer
Select To Compare
Kagome ⭐ 769
Self-contained Japanese Morphological Analyzer written in pure Go
dependent packages 27total releases 74most recent commit 4 months ago
Nagisa ⭐ 365
A Japanese tokenizer based on recurrent neural networks
dependent packages 7total releases 22most recent commit 4 months agopypi nagisa} Downloads
Vibrato ⭐ 275
🎤 vibrato: Viterbi-based accelerated tokenizer
dependent packages 1total releases 11most recent commit 5 months agocargo vibrato} Downloads
Vaporetto ⭐ 206
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
dependent packages 3total releases 16most recent commit 6 months agocargo vaporetto} Downloads
Toiro ⭐ 110
A comparison tool of Japanese tokenizers
total releases 8most recent commit 10 months ago


Suggest An Alternative To aws-lambda-ja-tokenizer
Alternative Project Comparisons
Aws Lambda Ja Tokenizer vs Kagome
Aws Lambda Ja Tokenizer vs Bert Japanese
Aws Lambda Ja Tokenizer vs Nagisa
Aws Lambda Ja Tokenizer vs Fugashi
Aws Lambda Ja Tokenizer vs Jumanpp
Aws Lambda Ja Tokenizer vs Sudachipy
Aws Lambda Ja Tokenizer vs Vibrato
Aws Lambda Ja Tokenizer vs Vaporetto
Aws Lambda Ja Tokenizer vs Konoha
Aws Lambda Ja Tokenizer vs Toiro
Popular Tokenizer Projects
Sentencepiece ⭐ 8,851
Unsupervised text tokenizer for Neural Network-based text generation.
dependent packages 787total releases 34latest release May 02, 2023most recent commit 4 months agopypi sentencepiece} Downloads
Tokenizers ⭐ 8,056
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
dependent packages 362total releases 85latest release November 14, 2023most recent commit 4 months agopypi tokenizers} Downloads
Php Token Stream ⭐ 6,457
Wrapper around PHP's tokenizer extension.
dependent packages 188total releases 36latest release November 30, 2020most recent commit 3 years agopackagist phpunit/php-token-stream} Downloads
Tokenizer ⭐ 5,084
A small library for converting tokenized PHP source code into XML (and potentially other formats)
dependent packages 11total releases 8latest release November 20, 2023most recent commit 6 months agopackagist theseer/tokenizer} Downloads
Popular Japanese Projects
Nes.css ⭐ 20,093
NES-style CSS Framework | ファミコン風CSSフレームワーク
dependent packages 15total releases 9latest release December 17, 2019most recent commit 4 months agonpm nes.css} Downloads
Popular Compilers Categories
Llvm
Abstract Syntax Tree
Gcc
Clang
Emscripten
Wsl
Lexer
Jit
Ghc
Ida

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Amazon Web Services
Lambda Functions
Amazon
Japanese
Tokenizer
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.