Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Word Segmentation Open Source Projects

Open source projects categorized as Python Word Segmentation
Categories > Machine Learning > Word Segmentation
Pkuseg Python ⭐ 6,001
pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation
dependent packages 8total releases 22most recent commit a year agopypi pkuseg} Downloads
Lac ⭐ 3,644
百度NLP：分词，词性标注，命名实体识别，词重要性
dependent packages 12total releases 15most recent commit 3 years agopypi LAC} Downloads
Subword Nmt ⭐ 1,937
Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
dependent packages 18total releases 8most recent commit 2 years agopypi subword-nmt} Downloads
Pythainlp ⭐ 902
Thai Natural Language Processing in Python.
dependent packages 51total releases 101most recent commit 3 months agopypi pythainlp} Downloads
Fasthan ⭐ 730
fastHan是基于fastNLP与pytorch实现的中文自然语言处理工具，像spacy一样调用方
total releases 9most recent commit 4 months ago
Symspellpy ⭐ 693
Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm
dependent packages 25total releases 22most recent commit 10 months agopypi symspellpy} Downloads
Ekphrasis ⭐ 583
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
total releases 54most recent commit 2 years ago
Vncorenlp ⭐ 472
A Vietnamese natural language processing toolkit (NAACL 2018)
most recent commit a year ago
Ckip Transformers ⭐ 439
CKIP Transformers
most recent commit a year ago
Nagisa ⭐ 365
A Japanese tokenizer based on recurrent neural networks
dependent packages 7total releases 22most recent commit 3 months agopypi nagisa} Downloads
Adaseq ⭐ 295
AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models
total releases 11most recent commit 5 months ago
Pycantonese ⭐ 290
Cantonese Linguistics and NLP
total releases 24most recent commit a year ago
Python Wordsegment ⭐ 268
English word segmentation, written in pure-Python, and based on a trillion-word corpus.
most recent commit 4 years ago
Multi Criteria Cws ⭐ 260
Simple Solution for Multi-Criteria Chinese Word Segmentation
most recent commit 5 years ago
Yaha ⭐ 258
yaha
total releases 3most recent commit 6 years ago
Pytorch Nlu ⭐ 226
Pytorch-NLU，一个中文文本分类、序列标注工具包，支持中文长文本、短文本的多类、多标签分类任 Ptorch NLU, a Chinese text classification and sequence annotation toolkit, supports multi class and multi label classification tasks of Chinese long text and short text, and supports sequence annotation tasks such as Chinese named entity recognition, part of speech tagging and word segmentation.
total releases 2most recent commit 9 months ago
Monpa ⭐ 222
MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型
total releases 10most recent commit 2 years ago
Kiwipiepy ⭐ 182
Python API for Kiwi
dependent packages 4total releases 42most recent commit 5 months agopypi kiwipiepy} Downloads
Bi Lstm Crf ⭐ 180
A PyTorch implementation of the BI-LSTM-CRF model.
total releases 5most recent commit a year ago
Deeplearning_nlp ⭐ 149
基于深度学习的自然语言处理库
most recent commit 5 years ago
Convseg ⭐ 130
Convolutional neural network and word embeddings for Chinese word segmentation
most recent commit 2 years ago
Id Cnn Cws ⭐ 130
Source codes and corpora of paper "Iterated Dilated Convolutions for Chinese Word Segmentation"
most recent commit 3 years ago
Review Helpfulness Prediction ⭐ 126
Project of automatically detecting review helpfulness. Using
most recent commit 3 years ago
The 9 Most Depended On Python Word Segmentation Open Source Projects
Pythainlp ⭐ 902
Thai Natural Language Processing in Python.
dependent packages 51total releases 101latest release November 26, 2023most recent commit 3 months agopypi pythainlp} Downloads
Subword Nmt ⭐ 1,937
Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
dependent packages 18total releases 8latest release December 08, 2021most recent commit 2 years agopypi subword-nmt} Downloads
Lac ⭐ 3,644
百度NLP：分词，词性标注，命名实体识别，词重要性
dependent packages 12total releases 15latest release May 25, 2021most recent commit 3 years agopypi LAC} Downloads
Pkuseg Python ⭐ 6,001
pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation
dependent packages 8total releases 22latest release June 19, 2020most recent commit a year agopypi pkuseg} Downloads
Nagisa ⭐ 365
A Japanese tokenizer based on recurrent neural networks
dependent packages 7total releases 22latest release July 30, 2023most recent commit 3 months agopypi nagisa} Downloads
Python Vncorenlp ⭐ 26
A Python wrapper for VnCoreNLP using a bidirectional communication channel.
dependent packages 4total releases 3latest release July 25, 2018most recent commit 6 years agopypi vncorenlp} Downloads
Kiwipiepy ⭐ 182
Python API for Kiwi
dependent packages 4total releases 42latest release November 20, 2023most recent commit 5 months agopypi kiwipiepy} Downloads
Rakutenma Python ⭐ 14
Rakuten MA (Python version)
dependent packages 1total releases 10latest release May 22, 2017most recent commit 7 years agopypi rakutenma} Downloads
The 10 Latest Releases In Python Word Segmentation Open Source Projects
Pythainlp ⭐ 902
Thai Natural Language Processing in Python.
dependent packages 51total releases 101latest release November 26, 2023most recent commit 3 months agopypi pythainlp} Downloads
Kiwipiepy ⭐ 182
Python API for Kiwi
dependent packages 4total releases 42latest release November 20, 2023most recent commit 5 months agopypi kiwipiepy} Downloads
Adaseq ⭐ 295
AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models
total releases 11latest release November 15, 2023most recent commit 5 months ago
Fasthan ⭐ 730
fastHan是基于fastNLP与pytorch实现的中文自然语言处理工具，像spacy一样调用方
total releases 9latest release November 11, 2023most recent commit 4 months ago
Toiro ⭐ 110
A comparison tool of Japanese tokenizers
total releases 8latest release July 31, 2023most recent commit 9 months ago
Nagisa ⭐ 365
A Japanese tokenizer based on recurrent neural networks
dependent packages 7total releases 22latest release July 30, 2023most recent commit 3 months agopypi nagisa} Downloads
Symspellcpppy ⭐ 35
Fast SymSpell written in c++ and exposes to python via pybind11
total releases 18latest release November 19, 2022most recent commit a year ago
Ocrd_calamari ⭐ 12
Recognize text using Calamari OCR and the OCR-D framework
total releases 14latest release September 20, 2022most recent commit 6 months ago
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.