Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 9 Flash Attention Open Source Projects

Open source projects categorized as Flash Attention
Categories > Flash Attention
Qwen ⭐ 11,085
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
most recent commit 2 months ago
Chinese Llama Alpaca 2 ⭐ 5,810
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
most recent commit 5 months ago
Internlm ⭐ 4,412
Official release of InternLM2 7B and 20B base and chat models. 200K context support
most recent commit 5 months ago
Awesome Llm Inference ⭐ 715
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
most recent commit 5 months ago
Flash_attention_inference ⭐ 72
Performance of the C++ interface of flash attention, flash attention v2 and self quantized decoding attention in large language model (LLM) inference scenarios.
most recent commit 7 months ago
Gdgpt ⭐ 58
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
most recent commit 5 months ago
Fastckpt ⭐ 18
Python package for rematerialization-aware gradient checkpointing
most recent commit 8 months ago
Flashperceiver ⭐ 7
Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.
most recent commit 8 months ago
Fastcode ⭐ 7
Utilities for efficient fine-tuning, inference and evaluation of code generation models
most recent commit 9 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.