Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 3 Word Segmentation Tokenization Open Source Projects

Open source projects categorized as Word Segmentation Tokenization
Categories > Tokenization
Categories > Machine Learning > Word Segmentation
Youtokentome ⭐ 943
Unsupervised text tokenizer focused on computational efficiency
dependent packages 17total releases 14most recent commit 18 days agopypi youtokentome} Downloads
Ekphrasis ⭐ 583
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
total releases 54most recent commit 2 years ago
Youtokentome Ruby ⭐ 20
High performance unsupervised text tokenization for Ruby
most recent commit 4 months ago
The 2 Latest Releases In Word Segmentation Tokenization Open Source Projects
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.