Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 19 Pretrain Open Source Projects

Open source projects categorized as Pretrain
Categories > Pretrain
Nlp_chinese_corpus ⭐ 8,344
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
most recent commit a year ago
Spark ⭐ 1,355
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
most recent commit 3 months ago
Cluecorpus2020 ⭐ 517
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
most recent commit 2 years ago
Sentiment_analysis_fine_grain ⭐ 504
Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger
most recent commit 5 years ago
Gcvit ⭐ 399
[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
most recent commit 4 months ago
Fan ⭐ 389
Official PyTorch implementation of Fully Attentional Networks
most recent commit 2 years ago
Univl ⭐ 264
An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
most recent commit a year ago
Firefly Llama2 Chinese ⭐ 199
Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、
most recent commit 6 months ago
Xlnet_zh ⭐ 175
中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
most recent commit 5 years ago
What I Have Read ⭐ 149
Paper Lists, Notes and Slides, Focus on NLP. For summarization, please refer to https://github.com/xcfcode/Summarization-Papers
most recent commit 2 years ago
Lert ⭐ 114
LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）
most recent commit a year ago
Endo Fm ⭐ 104
[MICCAI'23] Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-train
most recent commit 4 months ago
Bert Ccpoem ⭐ 89
BERT-CCPoem is an BERT-based pre-trained model particularly for Chinese classical poetry
most recent commit 2 years ago
Re Context Or Names ⭐ 88
Bert-based models(BERT, MTB, CP) for relation extraction.
most recent commit 2 years ago
Matdgl ⭐ 63
MatDGL is a neural network package that allows researchers to train custom models for crystal modeling tasks. It aims to accelerate the research and application of material science.
most recent commit 2 years ago
L2p Gnn ⭐ 46
Codes and datasets for AAAI-2021 paper "Learning to Pre-train Graph Neural Networks"
most recent commit 3 years ago
Self Supervised Learning For Sequential Recommender Systems ⭐ 14
[CCIR 2023] Self-supervised learning for Sequential Recommender Systems
most recent commit 6 months ago
Albert Mongolian ⭐ 11
ALBERT trained on Mongolian text corpus
most recent commit 3 years ago
Mfm ⭐ 11
code for paper "Masked Frequency Modeling for Self-Supervised Visual Pre-Training" (https://arxiv.org/pdf/2206.07706.pdf)
most recent commit a year ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.