Awesome Open Source

Programming Languages

Search results for llm llama

232 search results found

Ollama ⭐ 53,711

Get up and running with Llama 2, Mistral, Gemma, and other large language models.

Langchain Chatchat ⭐ 21,633

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM) QA app with langchain

Localai ⭐ 19,531

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

Chinese Llama Alpaca ⭐ 15,877

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Vllm ⭐ 13,832

A high-throughput and memory-efficient inference and serving engine for LLMs

Dalai ⭐ 12,940

The simplest way to run LLaMA on your local machine

Paddlenlp ⭐ 10,908

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

Ludwig ⭐ 10,740

Low-code framework for building custom LLMs, neural networks, and other AI models

Llama Factory ⭐ 10,715

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

Llama Gpt ⭐ 9,682

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Openllm ⭐ 7,871

Operating LLMs in production

Powerinfer ⭐ 6,416

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Gptcache ⭐ 5,954

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Chinese Llama Alpaca 2 ⭐ 5,810

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Awesome Chinese Llm ⭐ 5,477

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微

Huatuo Llama Med Chinese ⭐ 3,776

Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Firefly ⭐ 3,505

Firefly(流萤): 中文对话式大语言模型(全量微调+QLoRA)，支持微调Mixtral-8x7B、Zephyr、Mis

H2o Llmstudio ⭐ 3,268

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/

Higgsfield ⭐ 3,235

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

Interngpt ⭐ 2,976

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Langchain Chatglm Webui ⭐ 2,650

基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答

Anima ⭐ 2,455

33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU

Xturing ⭐ 2,392

Easily build, customize and control your own LLMs

Agixt ⭐ 2,267

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Alpaca Cot ⭐ 2,235

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

Medicalgpt ⭐ 2,127

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练、有监督微调、RLHF(奖励建模、强化学习训练)和DPO(直接偏

Simple Llm Finetuner ⭐ 1,977

Simple UI for LLM Model Finetuning

Langfuse ⭐ 1,901

🪢 Open source LLM observability, analytics, prompt management, evaluations, tests, monitoring, logging, tracing, LLMOps. 🕵️‍♂️ Langfuse: the LLM engineering platform. Debug, analyze and iterate together - 🍊YC W23 🤖 Stable SDKs + integrations for Typescript, Python, OpenAI, Langchain, Litellm, Flowise, Superagent and Langflow

Text Generation Webui Colab ⭐ 1,872

A colab gradio web UI for running Large Language Models

Mergekit ⭐ 1,839

Tools for merging pretrained large language models.

Lmdeploy ⭐ 1,762

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Casibase ⭐ 1,558

⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️, supports OpenAI, Azure, LLaMA, Google Gemini, HuggingFace, Claude, Grok, etc., chat bot demo: https://demo.casibase.com, admin UI demo: https://demo-admin.casibase.com

Awesome Decentralized Llm ⭐ 1,523

Collection of LLM resources that can be used to build products you can "own" or to perform reproducible research.

Lightllm ⭐ 1,417

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Llamasharp ⭐ 1,348

Run local LLaMA/GPT model easily and fast in C#!🤗 It's also easy to integrate LLamaSharp with semantic-kernel, unity, WPF and WebApp.

Basaran ⭐ 1,279

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Nitro ⭐ 1,115

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Easyedit ⭐ 1,095

An Easy-to-use Knowledge Editing Framework for LLMs.

Safe Rlhf ⭐ 1,040

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Bert4torch ⭐ 1,035

An elegent pytorch implement of transformers

Llama.go ⭐ 1,001

llama.go is like llama.cpp in pure Golang!

Data Juicer ⭐ 994

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！

FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目，利用开源开放来促进「AI+金融」。

Langroid ⭐ 988

Harness LLMs with Multi-Agent Programming

Llm Chain ⭐ 965

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM, Llama, Baichuan, Qwen, ChatGLM)

Genai_llm_timeline ⭐ 853

ChatGPT, GenerativeAI and LLMs Timeline

Llama Node ⭐ 846

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

Spacy Llm ⭐ 806

🦙 Integrating LLMs into structured NLP pipelines

Curated Transformers ⭐ 790

🤖 A PyTorch library of curated Transformer models and their composable components

Chatgentitle ⭐ 738

🌟 ChatGenTitle：使用百万arXiv论文信息在LLaMA模型上进行微调的论文题目生成模型

Local Llm Comparison Colab Ui ⭐ 723

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Llmcompiler ⭐ 714

LLMCompiler: An LLM Compiler for Parallel Function Calling

Llama 2 Open Source Llm Cpu Inference ⭐ 712

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Genossgpt ⭐ 670

One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.

Lawyer Llama ⭐ 636

中文法律LLaMA (LLaMA for Chinese legel domain)

Llm Pruner ⭐ 616

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

Llm Finetuning ⭐ 582

LLM Finetuning with peft

魔搭大模型训练推理部署工具箱，支持LLaMA、千问、ChatGLM、BaiChuan等多种模型及Lo LLM training/inference/deployment framework of ModelScope community, Support various models like LLaMA, Qwen, ChatGLM, Baichuan and others, and training methods like LoRA, ResTuning, NEFTune, etc.)

Llama Moe ⭐ 497

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

Squeezellm ⭐ 486

SqueezeLLM: Dense-and-Sparse Quantization

Educhat ⭐ 467

An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM

Llama2 Code Interpreter ⭐ 464

Make Llama2 use Code Execution, Debug, Save Code, Reuse it, Access to Internet

Finetune_llms ⭐ 421

Repo for fine-tuning Casual LLMs

Llavavision ⭐ 409

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Node Llama Cpp ⭐ 385

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Qizhengpt ⭐ 376

QiZhenGPT: An Open Source Chinese Medical Large Language Model｜一个开源的中文医疗大语言模型

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Llm Shearing ⭐ 351

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Awesome Llm And Aigc ⭐ 339

🚀🚀🚀A collection of some awesome public projects about Large Language Model, Vision Foundation Model and AI Generated Content.

Docker Llama2 Chat ⭐ 333

Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)

Llama Cult And More ⭐ 323

Large Language Models for All, 🦙 Cult and More, Stay in touch !

Are Copilots Local Yet ⭐ 296

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

Production-Ready LLM Agent SDK for Every Developer

Start Llms ⭐ 271

A complete guide to start and improve your LLM skills in 2023 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Llm Zoo ⭐ 265

LLM Zoo collects information of various open- and close-sourced LLMs

Selfhostedai ⭐ 261

A collection of one-click self-hosted AI

Llama Tokenizer Js ⭐ 250

JS tokenizer for LLaMA

Freegpt ⭐ 246

freeGPT provides free access to text and image generation models.

Jlama is a pure Java implementation of a LLM inference engine.

Llama Pro ⭐ 232

Progressive LLaMA with Block Expansion.

Realtime Bakllava ⭐ 226

llama.cpp with BakLLaVA model describes what does it see

Llm Rlhf Tuning ⭐ 225

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

Langchain Alpaca ⭐ 219

Run Alpaca LLM in LangChain

Step_into_llm ⭐ 211

MindSpore online courses: Step into LLM

Firefly Llama2 Chinese ⭐ 199

Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、

Llama.onnx ⭐ 196

LLaMa/RWKV onnx models, quantization and testcase

Humanable Chat Generative-model Fine-tuning | LLM微调

Vocab Coverage ⭐ 191

语言模型中文认知能力分析

Willow Inference Server ⭐ 190

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

All-in-one desktop app for running LLMs locally.

Llama2.c For Dummies ⭐ 164

Step by step explanation/tutorial of llama2.c

Atomgpt ⭐ 159

中英文预训练大模型，目标与ChatGPT的水平一致

Humanscript ⭐ 159

A truly natural scripting language

Arxivqa ⭐ 158

WIP - Automated Question Answering for ArXiv Papers with Large Language Models (https://arxiv.taesiri.xyz/)

Rtp Llm ⭐ 157

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Related Searches

Python Llm (1,377)

Artificial Intelligence Llm (622)

Openai Llm (569)

Chatgpt Llm (533)

Natural Language Processing Llm (285)

Llm Langchain (263)

Typescript Llm (258)

Machine Learning Llm (214)

Llm Large Language Models (213)

1-100 of 232 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.