Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Punkt

A port of the Punkt sentence tokenizer to Go
Stars
5
License
mit
Open Issues
0
Most Recent Commit
9 years ago
Programming Language
Go
Latest Release
May 27, 2021
Categories
Repo
Suggest An Alternative To punkt
Popular Tokenizer Projects
Sentencepiece ⭐ 8,851
Unsupervised text tokenizer for Neural Network-based text generation.
dependent packages 787total releases 34latest release May 02, 2023most recent commit 4 months agopypi sentencepiece} Downloads
Tokenizers ⭐ 8,056
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
dependent packages 362total releases 85latest release November 14, 2023most recent commit 4 months agopypi tokenizers} Downloads
Php Token Stream ⭐ 6,457
Wrapper around PHP's tokenizer extension.
dependent packages 188total releases 36latest release November 30, 2020most recent commit 3 years agopackagist phpunit/php-token-stream} Downloads
Tokenizer ⭐ 5,084
A small library for converting tokenized PHP source code into XML (and potentially other formats)
dependent packages 11total releases 8latest release November 20, 2023most recent commit 5 months agopackagist theseer/tokenizer} Downloads
Popular Port Projects
Zxing ⭐ 31,908
ZXing ("Zebra Crossing") barcode scanning library for Java, Android
dependent packages 485total releases 19latest release July 30, 2023most recent commit 4 months ago
Croc ⭐ 25,512
Easily and securely send things from one computer to another :crocodile: :package:
total releases 139latest release November 09, 2023most recent commit 4 months ago
Masscan ⭐ 22,052
TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes.
total releases 1latest release February 27, 2018most recent commit 5 months ago
Micropython ⭐ 17,845
MicroPython - a lean and efficient Python implementation for microcontrollers and constrained systems
dependent packages 5total releases 12latest release October 05, 2023most recent commit 4 months agopypi mpremote} Downloads
Whistle ⭐ 13,399
HTTP, HTTP2, HTTPS, Websocket debugging proxy
dependent packages 21total releases 572latest release December 08, 2023most recent commit 4 months agonpm whistle} Downloads
Popular Compilers Categories
Llvm
Abstract Syntax Tree
Gcc
Clang
Emscripten
Wsl
Lexer
Jit
Ghc
Ida

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Golang
Ruby
Port
Tokenizer
Nltk
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.