Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for pytorch llm
llm
x
pytorch
x
61 search results found
Vllm
⭐
13,832
A high-throughput and memory-efficient inference and serving engine for LLMs
Peft
⭐
12,271
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Ludwig
⭐
10,830
Low-code framework for building custom LLMs, neural networks, and other AI models
Deeplake
⭐
7,743
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
Burn
⭐
7,015
Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.
Ml Engineering
⭐
6,720
Machine Learning Engineering Open Book
Bigdl
⭐
4,728
Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm
Zenml
⭐
3,626
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Llm Foundry
⭐
3,354
LLM training code for MosaicML foundation models
Higgsfield
⭐
3,235
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
Alpaca Cot
⭐
2,235
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台,我们欢迎开源爱好者发起任何有意义的pr!
Chinese Llama 2 7b
⭐
1,999
开源社区第一个能下载、能运行的中文 LLaMA2 模型!
Simple Llm Finetuner
⭐
1,977
Simple UI for LLM Model Finetuning
Mixtral Offloading
⭐
1,943
Run Mixtral-8x7B models in Colab or consumer desktops
Inference
⭐
1,584
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
Training Operator
⭐
1,447
Distributed ML Training and Fine-Tuning on Kubernetes
Llms From Scratch
⭐
1,373
Implementing a ChatGPT-like LLM from scratch, step by step
Bert4torch
⭐
1,035
An elegent pytorch implement of transformers
Data Juicer
⭐
994
A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据!
Curated Transformers
⭐
790
🤖 A PyTorch library of curated Transformer models and their composable components
Lorax
⭐
719
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Mosec
⭐
661
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
Llm Finetuning
⭐
582
LLM Finetuning with peft
Openrl
⭐
496
Unified Reinforcement Learning Framework
Ming
⭐
411
明医 (MING):中文医疗问诊大模型
Gpu_poor
⭐
371
Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization
Llama Cult And More
⭐
323
Large Language Models for All, 🦙 Cult and More, Stay in touch !
Xllm
⭐
285
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
Text2text
⭐
268
Text2Text: Crosslingual NLP/G toolkit
Llm_training_handbook
⭐
235
An open collection of methodologies to help with successful training of large language models.
Large_language_model_training_playbook
⭐
235
An open collection of implementation tips, tricks and resources for training large language models
Deepworks
⭐
226
A collection of Deep Learning projects and resources
Atomgpt
⭐
159
中英文预训练大模型,目标与ChatGPT的水平一致
Glake
⭐
158
GLake: optimizing GPU memory management and IO transmission.
Vlmevalkit
⭐
137
Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 30+ HF models, 15+ benchmarks
Easy Translate
⭐
128
Easy-Translate is a script for translating large text files with a SINGLE COMMAND. Easy-Translate is designed to be as easy as possible for beginners and as seamlesscustomizable and as possible for advanced users.
Llm Finetuning Large Language Models
⭐
120
LLM (Large Language Model) FineTuning
Alpaca 7b Chinese
⭐
70
Finetune LLaMA-7B with Chinese instruction datasets
Gdgpt
⭐
58
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
Pytorch Memory Optim
⭐
47
This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.
Huggingfaceguidedtourformac
⭐
31
A guided tour on how to use HuggingFace large language models on Macs with Apple Silicon
Mac Ml Speed Test
⭐
27
A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.
Awesome Rust List
⭐
22
A collection of some awesome public Rust programming language projects.
Llama_finetuning
⭐
21
LLaMA 大模型 finetuning
Chatglm Lora Rlhf Pytorch
⭐
21
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
Llama Megatron
⭐
18
A LLaMA1/LLaMA12 Megatron implement.
Vicuna Lora Rlhf Pytorch
⭐
17
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna
Ai_book
⭐
17
AI book for everyone
Pytorch_merge
⭐
16
Merge LLM that are split in to parts
Export_llama_to_onnx
⭐
14
export llama to onnx
Lightning Mlflow Hf
⭐
14
Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
Chatsakura
⭐
12
ChatSakura:Open-source multilingual conversational model.(开源多语言对话大模型)
Detect Fake Text
⭐
12
LLM - Detect AI Generated Text || Identify which essay was written by a large language model
Build Generative Ai Apps With Langchain
⭐
11
"Build Generative AI Apps with LangChain" is a repository that contains a comprehensive framework for building generative AI applications using LangChain, an innovative language modeling platform. This repository includes all the necessary code and documentation to help developers quickly build and deploy generative AI applications
Alpaca Lora Rlhf Pytorch
⭐
10
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
Openbb Chat
⭐
10
Chat interface for OpenBB based on a instruct finetuning of a LLM, similar to ChatGPT.
Text Lab
⭐
9
Boilerplate for TorchText Driven Deep Learning Research with PyTorch Lightning and Lightning Fabric
Glados Voice Assistant
⭐
7
GLaDOS Terminal-based AI Assistant
Babygpt
⭐
7
Something in the middle of Karpathy's mingpt model and video lectures, BabyGPT is an easy to use model on a much smaller scale (16 and 256 out channels , 5 heads, fine tuned). To be made useful on low powered devices.
Xllm Demo
⭐
5
Demo project using XLLM
Ray_vllm_inference
⭐
5
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
Related Searches
Python Pytorch (15,943)
Deep Learning Pytorch (7,533)
Jupyter Notebook Pytorch (4,892)
Machine Learning Pytorch (2,934)
Dataset Pytorch (1,848)
Pytorch Convolutional Neural Networks (1,777)
Pytorch Neural Network (1,631)
Pytorch Natural Language Processing (1,408)
Python Llm (1,377)
Pytorch Computer Vision (1,230)
1-61 of 61 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.