Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Kortok

The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
Stars
33
License
apache-2.0
Open Issues
0
Most Recent Commit
4 years ago
Programming Language
Python
Categories
Repo
Alternatives To Kortok
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Kobert1,035
a year ago5apache-2.0Jupyter Notebook
Korean BERT pre-trained cased (KoBERT)
Kagome769273 months ago74September 27, 20234mitGo
Self-contained Japanese Morphological Analyzer written in pure Go
Open Korean Text55266a year ago14August 07, 201813apache-2.0Scala
Open Korean Text Processor - An Open-source Korean Text Processor
Kogpt2382
2 years ago2other
Korean GPT-2 pretrained cased (KoGPT2)
Kobart320
2 years ago1otherPython
Korean BART
Elasticsearch Analysis Openkoreantext112
4 years ago1July 03, 20179apache-2.0Java
Korean analysis plugin that integrates open-korean-text module into elasticsearch.
Prenlp105
4 years ago15August 15, 2020apache-2.0Python
Preprocessing Library for Natural Language Processing
Doc2vec Api92
2 years ago1lgpl-2.1Python
document embedding and machine learning script for beginners
Kr Bert91
3 years ago1Python
KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch
Elasticsearch Analysis Korean81
7 years ago10Java
Korean Analysis Plugin for Elasticsearch
Alternatives To Kortok
Select To Compare
Kagome ⭐ 769
Self-contained Japanese Morphological Analyzer written in pure Go
dependent packages 27total releases 74most recent commit 3 months ago
Open Korean Text ⭐ 552
Open Korean Text Processor - An Open-source Korean Text Processor
dependent packages 6total releases 14most recent commit a year ago
Kobart ⭐ 320
Korean BART
most recent commit 2 years ago
Prenlp ⭐ 105
Preprocessing Library for Natural Language Processing
total releases 15most recent commit 4 years ago


Suggest An Alternative To kortok
Alternative Project Comparisons
Kortok vs Kobert
Kortok vs Kagome
Kortok vs Open Korean Text
Kortok vs Kogpt2
Kortok vs Kobart
Kortok vs Elasticsearch Analysis Openkoreantext
Kortok vs Prenlp
Kortok vs Doc2vec Api
Kortok vs Kr Bert
Kortok vs Elasticsearch Analysis Korean
Popular Korean Projects
Popular Tokenizer Projects
Sentencepiece ⭐ 8,851
Unsupervised text tokenizer for Neural Network-based text generation.
dependent packages 787total releases 34latest release May 02, 2023most recent commit 3 months agopypi sentencepiece} Downloads
Tokenizers ⭐ 8,056
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
dependent packages 362total releases 85latest release November 14, 2023most recent commit 3 months agopypi tokenizers} Downloads
Php Token Stream ⭐ 6,457
Wrapper around PHP's tokenizer extension.
dependent packages 188total releases 36latest release November 30, 2020most recent commit 3 years agopackagist phpunit/php-token-stream} Downloads
Tokenizer ⭐ 5,084
A small library for converting tokenized PHP source code into XML (and potentially other formats)
dependent packages 11total releases 8latest release November 20, 2023most recent commit 5 months agopackagist theseer/tokenizer} Downloads
Popular Community Categories
Social
Chinese
Conference
Japanese
Feedback
Meetup
Cats
Open Data
China
Stanford
Related Searches
Python Machine Translation
Python Korean
Python Tokenizer
Python Natural Language Understanding
Korean Tokenizer
Tokenizer Machine Translation
Korean Machine Translation
Tokenizer Natural Language Understanding
Machine Translation Natural Language Understanding

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Korean
Tokenizer
Machine Translation
Natural Language Understanding
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.