Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Unicode Tokenizer

Unicode Tokenizer following the Unicode Line Breaking algorithm
Stars
20
License
No license specified
Open Issues
0
Most Recent Commit
11 years ago
Programming Language
JavaScript
Monthly Downloads
npm unicode-tokenizer Downloads
Dependent Repos
1
Dependent Packages
4
Total Releases
5
Latest Release
September 15, 2012
Categories
Repo
Alternatives To Unicode Tokenizer
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Rustfst134cargo rustfst} Downloads34 months ago44September 18, 202323otherRust
Rust re-implementation of OpenFST - library for constructing, combining, optimizing, and searching weighted finite-state transducers (FSTs). A Python binding is also available.
Mystem Scala21
63 years ago5March 03, 20202mitScala
Morphological analyzer `mystem` wrapper for JVM languages
Unicode Tokenizer20npm unicode-tokenizer} Downloads1411 years ago5September 15, 2012JavaScript
Unicode Tokenizer following the Unicode Line Breaking algorithm
Deepai_nlp12
5 years ago1Python
Project for sharing nlp algorithms
Nutshell10
3 years ago3December 04, 2020mitPython
An unsupervised text summarization and information retrieval library under the hood using natural language processing models
Alternatives To Unicode Tokenizer
Select To Compare
Unicode Tokenizer ⭐ 20
Unicode Tokenizer following the Unicode Line Breaking algorithm
dependent packages 4total releases 5most recent commit 11 years agonpm unicode-tokenizer} Downloads


Suggest An Alternative To unicode-tokenizer
Alternative Project Comparisons
Unicode Tokenizer vs Rustfst
Unicode Tokenizer vs Mystem Scala
Unicode Tokenizer vs Deepai_nlp
Unicode Tokenizer vs Nutshell
Popular Algorithms Projects
Python ⭐ 175,076
All Algorithms implemented in Python
dependent packages 3total releases 8latest release September 18, 2022most recent commit 3 months agonpm tda} Downloads
Popular Tokenizer Projects
Sentencepiece ⭐ 8,851
Unsupervised text tokenizer for Neural Network-based text generation.
dependent packages 787total releases 34latest release May 02, 2023most recent commit 3 months agopypi sentencepiece} Downloads
Tokenizers ⭐ 8,056
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
dependent packages 362total releases 85latest release November 14, 2023most recent commit 3 months agopypi tokenizers} Downloads
Php Token Stream ⭐ 6,457
Wrapper around PHP's tokenizer extension.
dependent packages 188total releases 36latest release November 30, 2020most recent commit 3 years agopackagist phpunit/php-token-stream} Downloads
Tokenizer ⭐ 5,084
A small library for converting tokenized PHP source code into XML (and potentially other formats)
dependent packages 11total releases 8latest release November 20, 2023most recent commit 5 months agopackagist theseer/tokenizer} Downloads
Popular Computer Science Categories
Algorithms
Search
Graph
Stack
Hash
Vector
Data Structure
Matrix
Struct
Sort

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Javascript
Algorithms
Token
Unicode
Tokenizer
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.