Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pre Training Open Source Projects

Open source projects categorized as Pre Training
Categories > Pre Training
Llmsurvey ⭐ 7,255
The official GitHub page for the survey paper "A Survey of Large Language Models".
most recent commit 3 months ago
Lmops ⭐ 3,145
General technology for enabling AI capabilities w/ LLMs and MLLMs
most recent commit 20 days ago
Uer Py ⭐ 2,802
Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
most recent commit 5 months ago
Ofa ⭐ 2,142
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
most recent commit 6 months ago
Mplug Owl ⭐ 1,657
[Official Implementation] mPLUG-Owl & mPLUG-Owl2: Alibaba MLLM Family.
most recent commit 5 months ago
Awesome Self Supervised Gnn ⭐ 1,356
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
most recent commit 4 months ago
Spark ⭐ 1,355
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
most recent commit 3 months ago
Prompt In Context Learning ⭐ 1,236
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
most recent commit 3 months ago
Awesome Graph Self Supervised Learning ⭐ 1,194
Awesome Graph Self-Supervised Learning
most recent commit 4 months ago
Oscar ⭐ 995
Oscar and VinVL
most recent commit 8 months ago
Data Juicer ⭐ 994
A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！
total releases 3most recent commit 3 months ago
Tencentpretrain ⭐ 951
Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
most recent commit 3 months ago
Xmodaler ⭐ 929
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
most recent commit a year ago
Bert_language_understanding ⭐ 886
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
most recent commit 5 years ago
Knowlm ⭐ 870
An Open-sourced Knowledgable Large Language Model Framework.
most recent commit 3 months ago
Awesome Clip ⭐ 782
Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
most recent commit 9 months ago
Awesome Vision Language Pretraining Papers ⭐ 724
Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
most recent commit 2 years ago
Vl Bert ⭐ 680
Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".
most recent commit 2 years ago
Entity ⭐ 596
EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation
most recent commit 5 months ago
Swift ⭐ 578
魔搭大模型训练推理部署工具箱，支持LLaMA、千问、ChatGLM、BaiChuan等多种模型及Lo LLM training/inference/deployment framework of ModelScope community, Support various models like LLaMA, Qwen, ChatGLM, Baichuan and others, and training methods like LoRA, ResTuning, NEFTune, etc.)
dependent packages 1total releases 6most recent commit 3 months agopypi ms-swift} Downloads
Imagenet21k ⭐ 576
Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper
most recent commit a year ago
Awesome Timeseries Spatiotemporal Lm Llm ⭐ 541
A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.
most recent commit 3 months ago
Uni Mol ⭐ 495
Official Repository for the Uni-Mol Series Methods
most recent commit 3 months ago
The 10 Latest Releases In Pre Training Open Source Projects
Zeldarose ⭐ 27
Train transformer-based models.
total releases 15latest release October 06, 2023most recent commit 3 months ago
Sotastream ⭐ 18
A library for data streaming and augmentation
total releases 2latest release August 29, 2023most recent commit 5 months ago
Mlm Pytorch ⭐ 141
An implementation of masked language modeling for Pytorch, made as concise and simple as possible
total releases 4latest release February 02, 2022most recent commit 8 months ago
Marge Pytorch ⭐ 36
Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
total releases 21latest release January 14, 2021most recent commit 3 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.