Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Natural Language Processing Tokenization Open Source Projects

Open source projects categorized as Python Natural Language Processing Tokenization
Categories > Machine Learning > Natural Language Processing
Categories > Tokenization
Spacy ⭐ 28,628
💫 Industrial-strength Natural Language Processing (NLP) in Python
dependent packages 1,367total releases 226most recent commit 17 days agopypi spacy} Downloads
Trankit ⭐ 693
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
dependent packages 2total releases 20most recent commit 5 months agopypi trankit} Downloads
Spacy Streamlit ⭐ 688
👑 spaCy building blocks and visualizers for Streamlit apps
total releases 17most recent commit 9 months ago
Datacamp Python Data Science Track ⭐ 655
All the slides, accompanying code and exercises all stored in this repo. 🎈
most recent commit 9 months ago
Ekphrasis ⭐ 583
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
total releases 54most recent commit 2 years ago
Razdel ⭐ 226
Rule-based token, sentence segmentation for Russian language
dependent packages 7total releases 5most recent commit 9 months agopypi razdel} Downloads
Tokenizer ⭐ 224
Fast and customizable text tokenization library with BPE and SentencePiece support
dependent packages 5total releases 68most recent commit 9 months agopypi pyonmttok} Downloads
Vtext ⭐ 110
Simple NLP in Rust with Python bindings
dependent packages 1total releases 4most recent commit 3 years agopypi vtext} Downloads
Simplemma ⭐ 100
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
dependent packages 9total releases 14most recent commit 7 months agopypi simplemma} Downloads
Nlp Cheat Sheet Python ⭐ 98
NLP Cheat Sheet, Python, spacy, LexNPL, NLTK, tokenization, stemming, sentence detection, named entity recognition
most recent commit a year ago
Tweebanknlp ⭐ 94
[LREC 2022] An off-the-shelf pre-trained Tweet NLP Toolkit (NER, tokenization, lemmatization, POS tagging, dependency parsing) + Tweebank-NER dataset
most recent commit 3 months ago
Lima ⭐ 92
The Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.
total releases 22most recent commit 6 months ago
Nlpcloud Python ⭐ 63
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, intent classification, product description and ad generation, chatbot, grammar and spelling correction, keywords and keyphrases extraction, text generation, image generation, code generation, and more...
dependent packages 29total releases 41most recent commit 6 months agopypi nlpcloud} Downloads
Spacy Server ⭐ 57
🦜 Containerized HTTP API for industrial-strength NLP via spaCy and sense2vec
most recent commit 3 years ago
Mbti Personality Classifier ⭐ 51
A model which uses your social media posting predict your MBTI personality type.
most recent commit 4 months ago
Attacut ⭐ 47
A Fast and Accurate Neural Thai Word Segmenter
dependent packages 3total releases 17most recent commit 3 years agopypi attacut} Downloads
Python ⭐ 38
Rosette API Client Library for Python
total releases 31most recent commit 3 months ago
Spacy_russian_tokenizer ⭐ 26
Custom Russian tokenizer for spaCy
most recent commit 5 years ago
Nlp Tool ⭐ 19
Natural Language Processing Tool
most recent commit 5 months ago
Python Vaporetto ⭐ 17
🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
total releases 2most recent commit 8 months ago
Avocado ⭐ 12
AVocaDo : Strategy for Adapting Vocabulary to Downstream Domain
most recent commit 2 years ago
Natural Language Processing Fundamentals ⭐ 12
Use Python and NLTK to build out your own text classifiers and solve common NLP problems
most recent commit 4 years ago
Models ⭐ 11
Pre-trained models for tokenization, sentence segmentation and so on
dependent packages 1total releases 3most recent commit 7 years agopypi b-labs-models} Downloads
The 9 Most Depended On Python Natural Language Processing Tokenization Open Source Projects
Spacy ⭐ 28,628
💫 Industrial-strength Natural Language Processing (NLP) in Python
dependent packages 1,367total releases 226latest release October 16, 2023most recent commit 17 days agopypi spacy} Downloads
Simplemma ⭐ 100
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
dependent packages 9total releases 14latest release January 20, 2023most recent commit 7 months agopypi simplemma} Downloads
Razdel ⭐ 226
Rule-based token, sentence segmentation for Russian language
dependent packages 7total releases 5latest release March 26, 2020most recent commit 9 months agopypi razdel} Downloads
Tokenizer ⭐ 224
Fast and customizable text tokenization library with BPE and SentencePiece support
dependent packages 5total releases 68latest release January 11, 2023most recent commit 9 months agopypi pyonmttok} Downloads
Attacut ⭐ 47
A Fast and Accurate Neural Thai Word Segmenter
dependent packages 3total releases 17latest release March 13, 2020most recent commit 3 years agopypi attacut} Downloads
Trankit ⭐ 693
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
dependent packages 2total releases 20latest release March 26, 2022most recent commit 5 months agopypi trankit} Downloads
Vtext ⭐ 110
Simple NLP in Rust with Python bindings
dependent packages 1total releases 4latest release June 15, 2020most recent commit 3 years agopypi vtext} Downloads
Models ⭐ 11
Pre-trained models for tokenization, sentence segmentation and so on
dependent packages 1total releases 3latest release August 22, 2017most recent commit 7 years agopypi b-labs-models} Downloads
The 10 Latest Releases In Python Natural Language Processing Tokenization Open Source Projects
Spacy ⭐ 28,628
💫 Industrial-strength Natural Language Processing (NLP) in Python
dependent packages 1,367total releases 226latest release October 16, 2023most recent commit 17 days agopypi spacy} Downloads
Nlpashto ⭐ 10
Pashto Natural Language Processing Toolkit
total releases 23latest release October 09, 2023most recent commit 6 months ago
Bigrams ⭐ 6
Non-intrusive ngrams generations
total releases 3latest release January 25, 2023most recent commit 4 months ago
Simplemma ⭐ 100
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
dependent packages 9total releases 14latest release January 20, 2023most recent commit 7 months agopypi simplemma} Downloads
Tokenizer ⭐ 224
Fast and customizable text tokenization library with BPE and SentencePiece support
dependent packages 5total releases 68latest release January 11, 2023most recent commit 9 months agopypi pyonmttok} Downloads
Lima ⭐ 92
The Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.
total releases 22latest release December 22, 2022most recent commit 6 months ago
Spacy Streamlit ⭐ 688
👑 spaCy building blocks and visualizers for Streamlit apps
total releases 17latest release June 14, 2022most recent commit 9 months ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.