Awesome Open Source

Programming Languages

Search results for python flash attention

flash-attention x

6 search results found

Chinese Llama Alpaca 2 ⭐ 5,810

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Internlm ⭐ 4,412

Official release of InternLM2 7B and 20B base and chat models. 200K context support

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

Fastckpt ⭐ 18

Python package for rematerialization-aware gradient checkpointing

Utilities for efficient fine-tuning, inference and evaluation of code generation models

Flashperceiver ⭐ 7

Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.

Related Searches

Python Django (28,897)

Python Machine Learning (20,195)

Python Flask (17,643)

Python Dataset (14,792)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Command Line (13,351)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

1-6 of 6 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.