Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 6 Tokenizer Machine Translation Open Source Projects

Open source projects categorized as Tokenizer Machine Translation
Categories > Machine Learning > Machine Translation
Categories > Compilers > Tokenizer
Sacremoses ⭐ 476
Python port of Moses tokenizer, truecaser and normalizer
dependent packages 164total releases 53most recent commit 6 months agopypi sacremoses} Downloads
Bitextor ⭐ 260
Bitextor generates translation memories from multilingual websites
most recent commit 7 months ago
Tokenizer ⭐ 224
Fast and customizable text tokenization library with BPE and SentencePiece support
dependent packages 5total releases 68most recent commit 9 months agopypi pyonmttok} Downloads
Kortok ⭐ 33
The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
most recent commit 4 years ago
Ilmulti ⭐ 12
Tooling to play around with multilingual machine translation for Indian Languages.
total releases 2most recent commit 4 years ago
Nlpjenny ⭐ 5
This is a Natural Language Processing applications WebApp useful for basic NLP task implemented using State of the Art API's on Streamlit Framework
most recent commit 4 years ago
The 2 Most Depended On Tokenizer Machine Translation Open Source Projects
Sacremoses ⭐ 476
Python port of Moses tokenizer, truecaser and normalizer
dependent packages 164total releases 53latest release October 30, 2023most recent commit 6 months agopypi sacremoses} Downloads
Tokenizer ⭐ 224
Fast and customizable text tokenization library with BPE and SentencePiece support
dependent packages 5total releases 68latest release January 11, 2023most recent commit 9 months agopypi pyonmttok} Downloads
The 3 Latest Releases In Tokenizer Machine Translation Open Source Projects
Sacremoses ⭐ 476
Python port of Moses tokenizer, truecaser and normalizer
dependent packages 164total releases 53latest release October 30, 2023most recent commit 6 months agopypi sacremoses} Downloads
Tokenizer ⭐ 224
Fast and customizable text tokenization library with BPE and SentencePiece support
dependent packages 5total releases 68latest release January 11, 2023most recent commit 9 months agopypi pyonmttok} Downloads
Ilmulti ⭐ 12
Tooling to play around with multilingual machine translation for Indian Languages.
total releases 2latest release August 30, 2020most recent commit 4 years ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.