Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for deepspeed
deepspeed
x
25 search results found
Lmdeploy
⭐
1,762
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Safe Rlhf
⭐
1,040
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
Knowlm
⭐
870
An Open-sourced Knowledgable Large Language Model Framework.
Openrlhf
⭐
704
A Ray-based High-performance RLHF framework (Support 70B+ full tuning & LoRA & Mixtral)
Finetune Gpt2xl
⭐
382
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
Collie
⭐
337
Collaborative Training of Large Language Models in an Efficient Way
Llama Cult And More
⭐
323
Large Language Models for All, 🦙 Cult and More, Stay in touch !
Gpt Neo Fine Tuning Example
⭐
282
Fine-Tune EleutherAI GPT-Neo And GPT-J-6B To Generate Netflix Movie Descriptions Using Hugginface And DeepSpeed
Rlhf
⭐
257
Implementation of Chinese ChatGPT
Glake
⭐
158
GLake: optimizing GPU memory management and IO transmission.
Llms_tool
⭐
144
一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测,低参
Revlib
⭐
106
Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
L2hmc Qcd
⭐
60
Application of the L2HMC algorithm to simulations in lattice QCD.
Gdgpt
⭐
58
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
My Llm
⭐
34
All about large language models
Chatglm Lora Rlhf Pytorch
⭐
21
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
Vod
⭐
20
Retrieval-augmented LMs, at scale
Llm Pretrain Sft
⭐
20
Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)
Ai Msgbot
⭐
20
Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.
Pytorch Gpt X
⭐
14
Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
Train_law_llm
⭐
13
✏️0成本LLM微调上手项目,⚡️一步一步使用colab训练法律LLM,基于microsoft/ph
Alpaca Lora Rlhf Pytorch
⭐
10
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
Llmindcraft
⭐
7
Shaping Language Models with Cognitive Insights
Llama2 Lora Fine Tuning
⭐
6
llama2 finetuning with deepspeed and lora
Transformers Language Modeling
⭐
5
Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
Related Searches
Python Deepspeed (17)
Llama Deepspeed (7)
Gpt Deepspeed (6)
Llm Deepspeed (6)
Natural Language Processing Deepspeed (6)
Large Language Models Deepspeed (6)
Chatgpt Deepspeed (5)
Lora Deepspeed (5)
Jupyter Notebook Deepspeed (5)
Fine Tuning Deepspeed (4)
1-25 of 25 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.