Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Nagisa	365	1	7	3 months ago	22	July 30, 2023	4	mit	Python
A Japanese tokenizer based on recurrent neural networks
Deepcut	319	7	3	4 years ago	30	November 06, 2019		mit	Python
A Thai word tokenization library using Deep Neural Network
Neural_tokenizer	64			7 years ago				mit	Python
Tokenize English sentences using neural networks.
Sentencepiece Jni	27			a year ago			3	mit	C++
Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.
Paddletokenizer	13			4 years ago				agpl-3.0	JavaScript
使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 \| A DNN Chinese Tokenizer by Using PaddlePaddle
Neuraltokenizer	10	4	5	4 years ago	15	June 15, 2020		mpl-2.0	Kotlin
NeuralTokenizer is a very simple to use text tokenizer which uses neural networks from the SimpleDNN library.

Alternatives To Sentencepiece Jni

Select To Compare

Nagisa ⭐ 365

A Japanese tokenizer based on recurrent neural networks

dependent packages 7total releases 22most recent commit 3 months ago

Deepcut ⭐ 319

A Thai word tokenization library using Deep Neural Network

dependent packages 3total releases 30most recent commit 4 years ago

Neural_tokenizer ⭐ 64

Tokenize English sentences using neural networks.

most recent commit 7 years ago

Sentencepiece Jni ⭐ 27

Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.

most recent commit a year ago

Paddletokenizer ⭐ 13

使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 | A DNN Chinese Tokenizer by Using PaddlePaddle

most recent commit 4 years ago

Neuraltokenizer ⭐ 10

NeuralTokenizer is a very simple to use text tokenizer which uses neural networks from the SimpleDNN library.

dependent packages 5total releases 15most recent commit 4 years ago

Suggest An Alternative To sentencepiece-jni

Alternative Project Comparisons

Sentencepiece Jni vs Nagisa

Sentencepiece Jni vs Deepcut

Sentencepiece Jni vs Neural_tokenizer

Sentencepiece Jni vs Paddletokenizer

Sentencepiece Jni vs Neuraltokenizer

Popular Tokenizer Projects

Sentencepiece ⭐ 8,851

Unsupervised text tokenizer for Neural Network-based text generation.

dependent packages 787total releases 34latest release May 02, 2023most recent commit 3 months ago

Tokenizers ⭐ 8,056

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

dependent packages 362total releases 85latest release November 14, 2023most recent commit 3 months ago

Gpt2 Chinese ⭐ 7,249

Chinese version of GPT2 training code, using BERT tokenizer.

most recent commit 4 months ago

Php Token Stream ⭐ 6,457

Wrapper around PHP's tokenizer extension.

dependent packages 188total releases 36latest release November 30, 2020most recent commit 3 years ago

packagist phpunit/php-token-stream} Downloads

Tokenizer ⭐ 5,084

A small library for converting tokenized PHP source code into XML (and potentially other formats)

dependent packages 11total releases 8latest release November 20, 2023most recent commit 5 months ago

Popular Neural Network Projects

Tensorflow ⭐ 180,196

An Open Source Machine Learning Framework for Everyone

dependent packages 78total releases 46latest release October 23, 2019most recent commit 3 months ago

Pytorch ⭐ 74,794

Tensors and Dynamic neural networks in Python with strong GPU acceleration

dependent packages 8,272total releases 39latest release November 15, 2023most recent commit 3 months ago

Keras ⭐ 60,854

Deep Learning for humans

dependent packages 697total releases 87latest release December 06, 2023most recent commit 13 days ago

Faceswap ⭐ 48,125

Deepfakes Software For All

most recent commit 3 months ago

Deepfacelab ⭐ 43,455

DeepFaceLab is the leading software for creating deepfakes.

most recent commit 6 months ago

Popular Compilers Categories