Awesome Open Source

Programming Languages

Search results for c sharp tokenizer

25 search results found

Superpower ⭐ 848

A C# parser construction toolkit with high-quality error reporting

Tsql Parser ⭐ 278

Library Written in C# For Parsing SQL Server T-SQL Scripts in .Net

Opennlp ⭐ 221

Open source NLP tools (sentence splitter, tokenizer, chunker, coref, NER, parse trees, etc.) in C#

A WHOIS lookup and parsing library for .NET Standard 2.0 and .NET Framework 4.5.2

Sharptoken ⭐ 125

SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.

A C# Lua, GLua and Luau parser, code analysis, transformation and generation library.

Tokenizer ⭐ 53

Convert source code into numerical tokens

Cledev.openai ⭐ 49

.NET 7 SDK for OpenAI with a Blazor Server playground

Tokenizer ⭐ 41

.NET Tokenization Library

Sharpmath ⭐ 36

A small .NET math library.

Uwuscript ⭐ 36

World's first uwu-oriented language.

Cwsharp Go ⭐ 30

cwsharp-go, Golang中文分词库，支持多种分词模式，支持自定义字典和扩展。

The Parser Construction Kit ("Puck"): A Parser Generator and Grammar Translator in C#

SQLNado (SQLite Not ADO) is a .NET lightweight bloat free wrapper and object persistence framework based on SQLite.

Deeplearningsmells ⭐ 23

Smelling smells using Deep Learning

Uyghur Tokenizer ⭐ 14

A simple word level tokenizing library and tool for Uyghur language | ئۇيغۇرچە سۆز سۈزۈش كودى ۋە قۇرالى

Openai Tools ⭐ 13

A collection of tools for working with OpenAI

Tsqlflex.sqlparser ⭐ 10

Simple T-SQL Parser

Parsinghelper ⭐ 9

.NET text parsing helper class.

Llmsharp Tokenizers ⭐ 9

BPE Tokenizer implementations in C# for Anthropic, OpenAI LLM offerings

Humantimeparser ⭐ 9

Simple to use parser capable of parsing a usable time object from human input

A performant, type-safe .NET library for building tokenizers and parsers.

Sandwich client.

Tinytokenizer ⭐ 5

Conversion of TinySegmenter to C# plus a wrapper for tokenization

Huggingface ⭐ 5

Generated C# SDK based on official HuggingFace OpenAPI specification

Related Searches

C Sharp Unity (13,521)

C Sharp Video Game (8,498)

C Sharp Azure (4,292)

C Sharp Unity3d (4,236)

C Sharp Wpf (3,118)

C Sharp Visual Studio (2,839)

C Sharp Command Line (2,702)

C Sharp Asp Net Core (2,668)

C Sharp Microsoft (2,368)

C Sharp Sdk (2,355)

1-25 of 25 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.