Awesome Open Source

Programming Languages

Search results for deep learning pre training

deep-learning x

16 search results found

Awesome Self Supervised Gnn ⭐ 1,356

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

Spark ⭐ 1,355

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

Awesome Graph Self Supervised Learning ⭐ 1,194

Awesome Graph Self-Supervised Learning

An Open-sourced Knowledgable Large Language Model Framework.

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

Awesome Timeseries Spatiotemporal Lm Llm ⭐ 541

A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.

Uni Mol ⭐ 495

Official Repository for the Uni-Mol Series Methods

Electra Pytorch ⭐ 188

A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch

The official repo for [NeurIPS'23] "SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Model"

Mlm Pytorch ⭐ 141

An implementation of masked language modeling for Pytorch, made as concise and simple as possible

Scaling Laws Openclip ⭐ 112

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

Proteinworkshop ⭐ 93

Benchmarking framework for protein representation learning. Includes a large number of pre-training and downstream task datasets, models and training/task utilities.

Helo Word ⭐ 88

Team Kakao&Brain's Grammatical Error Correction System for the ACL 2019 BEA Shared Task

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

The official repo for [TGRS'22] "An Empirical Study of Remote Sensing Pretraining"

Official codes: Self-Supervised Learning by Estimating Twin Class Distribution

Marge Pytorch ⭐ 36

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

Pre Training Via Denoising ⭐ 29

Official implementation of pre-training via denoising for TorchMD-NET

Coco Lm Pytorch ⭐ 18

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch

Plmpapers ⭐ 12

A paper list of pre-trained language models (PLMs).

Large Scale Pretraining Transfer ⭐ 11

Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)

Tabular Dl Pretrain Objectives ⭐ 10

Revisiting Pretrarining Objectives for Tabular Deep Learning

[ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

预训练模型知识量度量竞赛 Baseline F1 0.35 BERTForMaskedLM

Concept Based Curriculum Masking ⭐ 5

Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking

Related Searches

Python Deep Learning (13,092)

Jupyter Notebook Deep Learning (10,328)

Deep Learning Pytorch (6,248)

Deep Learning Tensorflow (5,868)

Deep Learning Neural Network (5,801)

Deep Learning Convolutional Neural Networks (3,932)

Deep Learning Neural (3,734)

Deep Learning Network (3,571)

Deep Learning Keras (3,258)

Deep Learning Computer Vision (3,017)

1-16 of 16 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2025 Awesome Open Source. All rights reserved.