Awesome Open Source

Programming Languages

Search results for natural language processing unicode

natural-language-processing x

8 search results found

Sense2vec ⭐ 1,486

🦆 Contextually-keyed word vectors

Stringi ⭐ 292

Fast and portable character string processing in R (with the Unicode ICU)

Tokenizer ⭐ 224

Fast and customizable text tokenization library with BPE and SentencePiece support

Rouge 2.0 ⭐ 145

ROUGE automatic summarization evaluation toolkit. Support for ROUGE-[N, L, S, SU], stemming and stopwords in different languages, unicode text evaluation, CSV output.

Guide To Swift Strings Sample Code ⭐ 124

Xcode Playground Sample Code for the Flight School Guide to Swift Strings

Unihandecode ⭐ 71

unihandecode is a transliteration library to convert all characters/words in Unicode into ASCII alphabet that aware with Language preference priorities

Bengali Alphabet ⭐ 51

✍️ Bengali alphabet (বাংলা বর্ণমালা)

A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split words, sentences and graphemes.

Drop-in replacements for base R string functions powered by stringi

Urdu Characters ⭐ 18

📄 Complete collection of Urdu language characters & unicode code points.

Huge Word List ⭐ 17

basically all words, in a compressed form

Greeb is a simple Unicode-aware regexp-based tokenizer.

Bytepairencoding.jl ⭐ 15

Julia implementation of Byte Pair Encoding for NLP

Asosoft Library ⭐ 13

AsoSoft's Library for Kurdish language processing tasks

Tokenizer ⭐ 11

Natural Language Tokenizer

Japanese Numbers Python ⭐ 11

A parser for Japanese number (Kanji, arabic) in the natural language.

Jamotools ⭐ 10

A library for Korean Jamo split and vectorize.

A natural language tokenizer

A small python package to flexibly convert from betacode to unicode and back.

Related Searches

Python Natural Language Processing (7,915)

Jupyter Notebook Natural Language Processing (4,405)

Machine Learning Natural Language Processing (3,939)

Deep Learning Natural Language Processing (2,414)

Pytorch Natural Language Processing (1,212)

Artificial Intelligence Natural Language Processing (1,010)

Dataset Natural Language Processing (1,010)

Tensorflow Natural Language Processing (909)

Character Unicode (849)

Javascript Natural Language Processing (843)

1-8 of 8 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.