Awesome Open Source

Programming Languages

Search results for python llm inference

llm-inference x

36 search results found

Openllm ⭐ 7,871

Operating LLMs in production

Superduperdb ⭐ 3,924

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

Llm Action ⭐ 2,955

本项目旨在分享大模型相关技术原理以及实战经验。

Deepsparse ⭐ 2,729

Sparsity-aware deep learning inference runtime for CPUs

Intel Extension For Transformers ⭐ 1,712

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

Ray Llm ⭐ 972

RayLLM - LLMs on Ray

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Llmflows ⭐ 565

LLMFlows - Simple, Explicit and Transparent LLM Apps

Generativeaiexamples ⭐ 458

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

LLMs and Machine Learning done easily

irresponsible innovation. Try now at https://chat.dev/

Aquila2 ⭐ 376

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

Swiftinfer ⭐ 277

Efficient AI Inference & Serving

Talkingheads ⭐ 166

A Headless Chrome interface to communicate with Google Bard, HugginChat, OpenAI ChatGPT, and Pi

Llmtuner ⭐ 137

Tune LLM in few lines of code

Ialacol ⭐ 127

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Llm Api ⭐ 109

Run any Large Language Model behind a unified API

⚡️ Nitro boost your AI infrastructure.

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.

Libre Chat ⭐ 71

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup. Powered by LangChain.

Prompt Highlighter ⭐ 69

Prompt Highlighter: Interactive Control for Multi-Modal LLMs

Ecoassistant ⭐ 69

EcoAssistant: using LLM assistant more affordably and accurately

Local Llm Function Calling ⭐ 55

A tool for generating function arguments and choosing what function to call with local LLMs

Friendli Client ⭐ 23

Friendli: the fastest serving engine for generative AI such as LLMs

Local Llm ⭐ 21

支持chatglm.cpp和llama_cpp的一键安装启动

Gpt 4 Enem ⭐ 20

Code and data to evaluate LLMs on the ENEM, the main standardized Brazilian university admission exams.

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

Export_llama_to_onnx ⭐ 14

export llama to onnx

Arcee Python ⭐ 12

The Arcee client for executing domain-adpated language model routines

Llm Minutes Of Meeting ⭐ 11

🎤📄 An innovative tool that transforms audio or video files into text transcripts and generates concise meeting minutes. Stay organized and efficient in your meetings, and get ready for Phase 2 where we'll be open for contributions to enable real-time meeting transcription! 🚀

Instruct Finetune Mistral ⭐ 10

Fine-tune Mistral 7B to generate fashion style suggestions

Llm Vscode Inference Server ⭐ 9

An endpoint server for efficiently serving quantized open-source LLMs for code.

Prompter.vim ⭐ 9

vim as a perfect large language models prompts playground

Saycanpay ⭐ 8

Official code release of AAAI 2024 paper SayCanPay.

Modal LLM LLama.cpp based model deployment as part of series of Model as a Service (MaaS)

Analyze cyber threat research post from given URLs and get insights with the help of ChatGPT

Related Searches

Python Machine Learning (20,195)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Natural Language Processing (9,064)

Python Artificial Intelligence (8,580)

Python Amazon Web Services (7,946)

Python Pytorch (7,877)

Python Keras (6,821)

Python Json (5,730)

1-36 of 36 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.