Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Php Token Stream | 6,457 | 104,288 | 188 | 3 years ago | 36 | November 30, 2020 | other | PHP | ||
Wrapper around PHP's tokenizer extension. | ||||||||||
File Type | 3,366 | 64,893 | 1,894 | 6 months ago | 141 | November 11, 2023 | 16 | mit | JavaScript | |
Detect the file type of a Buffer/Uint8Array/ArrayBuffer | ||||||||||
Tokenizer | 138 | 333 | 97 | a year ago | 9 | February 09, 2022 | other | PHP | ||
[DISCONTINUED] Source code tokenizer | ||||||||||
Nlp Toolkit | 48 | 2 | 4 | 7 years ago | 8 | May 11, 2016 | 4 | JavaScript | ||
some helper functions for NLP operations | ||||||||||
Refmt | 45 | 48 | 315 | 7 months ago | 11 | December 10, 2022 | 17 | mit | Go | |
Object mapping for golang. | ||||||||||
Splitstream | 41 | 1 | 2 | a year ago | 9 | October 05, 2022 | 3 | apache-2.0 | C | |
Continuous object splitter for C and Python | ||||||||||
Strtok3 | 19 | 71 | 47 | 2 years ago | 89 | August 02, 2022 | 8 | mit | TypeScript | |
Promise based streaming tokenizer | ||||||||||
Tokenizer2 | 13 | 54 | 16 | 6 years ago | 7 | April 09, 2018 | mit | JavaScript | ||
tokenize any text stream given some basic regex rules to match tokens | ||||||||||
Haskell Css Syntax | 8 | 18 | a year ago | 9 | March 16, 2023 | mit | Haskell | |||
Tokenizer and parser for the CSS syntax | ||||||||||
Token Types | 5 | 74 | 41 | a year ago | 39 | August 02, 2022 | 15 | mit | TypeScript | |
A primitive token library used to read from, and to write a node Buffer |