Cang Jie

Chinese tokenizer for tantivy, based on jieba-rs
Alternatives To Cang Jie
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Gpt2 Chinese7,249
4 months ago105mitPython
Chinese version of GPT2 training code, using BERT tokenizer.
Ckip Transformers439
a year ago1gpl-3.0Python
CKIP Transformers
5 months ago10mitC++
支持中文和拼音的 SQLite fts5 全文搜索扩展 | A SQLite3 fts5 tokenizer which supports Chinese and PinYin
Segmentit20816a year ago17December 22, 20196mitJavaScript
任何 JS 环境可用的中文分词包,fork from leizongmin/node-segment
8 years agoC
An open source tokenizer which supports fast substring search with sqlite FTS (full text search)
Cang Jie6566 months ago20November 04, 2023mitRust
Chinese tokenizer for tantivy, based on jieba-rs
Ud Kanbun59123 months ago249September 25, 2023mitPython
Tokenizer POS-tagger and Dependency-parser for Classical Chinese
3 years ago1apache-2.0Python
rasa_chinese 专门针对中文语言的 rasa 组件扩展包,提供了许多针对中文语言的组件
Chinese Tokenizer39374 years ago11June 05, 20192mitJavaScript
Tokenizes Chinese texts into words.
Pnlp25113 months ago38December 25, 2022apache-2.0Python
Alternatives To Cang Jie
Select To Compare

Alternative Project Comparisons
Popular Tokenizer Projects
Popular Chinese Projects
Popular Compilers Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Full Text Search