Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for language tokenizer
language
x
tokenizer
x
35 search results found
Nlp With Ruby
⭐
1,002
Curated List: Practical Natural Language Processing done in Ruby
Goro
⭐
673
PHP in Go
Tabloid
⭐
365
A minimal programming language inspired by clickbait headlines
Query Translator
⭐
176
Query Translator is a search query translator with AST representation
Gruut
⭐
153
A tokenizer, text cleaner, and phonemizer for many human languages.
Nlc
⭐
150
Neural Language Correction implemented on Tensorflow
Vokenization
⭐
133
PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
Rasa Nlu Examples
⭐
120
This repository contains examples of custom components for educational purposes.
Transphone
⭐
102
phoneme tokenizer and grapheme-to-phoneme model for 8k languages
Tokenizer
⭐
75
NLP tokenizers written in Go language
Monaco Ace Tokenizer
⭐
72
Syntax highlighting support for additional languages in monaco-editor
Neural_tokenizer
⭐
64
Tokenize English sentences using neural networks.
Nlp Toolkit
⭐
48
some helper functions for NLP operations
Alm
⭐
47
Smart Language Model
Talismane
⭐
45
NLP framework: sentence detector, tokeniser, pos-tagger and dependency parser
Chinese Tokenizer
⭐
39
Tokenizes Chinese texts into words.
Nlpt
⭐
35
Natural Language Processing Toolkit written in Go (DEPRECATED see individual packages prefixed nlpt-)
Nlp For Sanskrit
⭐
30
State of the Art Language models and Classifier for Sanskrit language (ancient indian language)
Excel Formula Tokenizer
⭐
26
Tokenize Excel formulas
Tok Tok
⭐
26
A fast, simple, multilingual tokenizer
Spacy_russian_tokenizer
⭐
26
Custom Russian tokenizer for spaCy
Lisp Esque Language
⭐
24
💠The Lel programming language
Trainable Tokenizer
⭐
22
Fast and trainable tokenizer for natural languages relying on maximum entropy methods.
Spacy Thai
⭐
22
Dependency parser on Thai language
Toy_lang
⭐
21
The first language I made.
Lic2019_ie
⭐
21
2019 Language and Intelligence Challenge, Information Extraction
Maeel
⭐
21
The maeel programming language
Buckwheat
⭐
19
A multi-language tokenizer for extracting identifiers from source code.
Pyidaungsu
⭐
19
Python library for Myanmar language
Language.dart
⭐
18
🌺 Natural language processing utilities for Dart
Mirusan
⭐
17
A PDF collection reader with built-in full-text search engine
Thailmcut
⭐
15
Arabicprocessingcog
⭐
15
A Python package that do stemming, tokenization, sentence breaking, segmentation, normalization, POS tagging for Arabic language.
Icu Tokenizer
⭐
13
ICU based universal language tokenizer
Ilmulti
⭐
12
Tooling to play around with multilingual machine translation for Indian Languages.
Limonite
⭐
10
[WIP] Compiler for the Limonite programming language.
Fql
⭐
10
Filter Query Language (FQL)
Esperanto Analyzer
⭐
10
Morphological and syntactic analysis of Esperanto sentences
Sctokenizer
⭐
9
A Source Code Tokenizer
Rmalt
⭐
7
the malt language implemented by rbnf. https://github.com/malt-project/cmalt
Copy Paste Detector
⭐
6
copy-paste-detector is a copy/paste-detector for various languages
Transpyler
⭐
5
A framework for generating internationalized versions of Python.
Map4d Tokenizer Elasticsearch
⭐
5
Map4D tokenizer elasticsearch plugin for Vietnamese language
Related Searches
Python Natural Language Processing (5,234)
Python Language (4,552)
Javascript Language (4,116)
Java Language (2,399)
C Plus Plus Language (1,971)
Php Language (1,770)
Language Translation (1,649)
C Language (1,627)
Golang Language (1,201)
Typescript Language (1,185)
1-35 of 35 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.