Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Deep Learning Optimizer Open Source Projects

Open source projects categorized as Deep Learning Optimizer
Categories > Machine Learning > Deep Learning
Categories > Media > Optimizer
Annotated_deep_learning_paper_implementations ⭐ 41,877
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
dependent packages 2total releases 79most recent commit 3 months agopypi labml-nn} Downloads
Openvino ⭐ 5,316
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
total releases 3most recent commit 3 months ago
Learning To Learn ⭐ 3,961
Learning to Learn in TensorFlow
total releases 1most recent commit 4 years ago
Lion Pytorch ⭐ 1,553
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
dependent packages 25total releases 10most recent commit 9 months agopypi lion-pytorch} Downloads
Axon ⭐ 1,381
Nx-powered Neural Networks
dependent packages 5total releases 9most recent commit 4 months agohex axon} Downloads
Deep Learning Notes ⭐ 1,257
Experiments with Deep Learning
most recent commit 4 years ago
Pytorch Center Loss ⭐ 842
Pytorch implementation of Center Loss
most recent commit a year ago
Sophia ⭐ 795
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
most recent commit 3 months ago
Adan ⭐ 672
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
most recent commit 5 months ago
Torchopt ⭐ 460
TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
dependent packages 2total releases 14most recent commit 4 months agopypi torchopt} Downloads
Adamp ⭐ 399
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
dependent packages 1total releases 4most recent commit 3 years agopypi adamp} Downloads
Sophia ⭐ 324
Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
total releases 8most recent commit 5 months ago
Bluefog ⭐ 282
Distributed and decentralized training framework for PyTorch over graph
total releases 10most recent commit a year ago
Model_optimization ⭐ 245
Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.
most recent commit 3 months ago
Adan Pytorch ⭐ 187
Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
total releases 6most recent commit 2 years ago
Teacher Assistant Knowledge Distillation ⭐ 157
Using Teacher Assistants to Improve Knowledge Distillation
most recent commit 5 years ago
Pytorch_workplace ⭐ 153
Random miniprojects with pytorch.
most recent commit 5 years ago
Pytorch_optimizer ⭐ 149
optimizer & lr scheduler & loss function collections in PyTorch
dependent packages 1total releases 63most recent commit 4 months agopypi pytorch-optimizer} Downloads
L4 Optimizer ⭐ 130
Code for paper "L4: Practical loss-based stepsize adaptation for deep learning"
most recent commit 5 years ago
Keras Adabound ⭐ 123
Keras implementation of AdaBound
most recent commit 4 years ago
Wicwiu ⭐ 105
WICWIU(What I can Create is What I Understand)
most recent commit a year ago
Gradient Centralization Tensorflow ⭐ 99
Instantly improve your training performance of TensorFlow models with just 2 lines of code!
most recent commit 2 years ago
Deepobs ⭐ 97
DeepOBS: A Deep Learning Optimizer Benchmark Suite
most recent commit 4 months ago
The 6 Most Depended On Deep Learning Optimizer Open Source Projects
Axon ⭐ 1,381
Nx-powered Neural Networks
dependent packages 5total releases 9latest release August 17, 2023most recent commit 4 months agohex axon} Downloads
Torchopt ⭐ 460
TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
dependent packages 2total releases 14latest release November 10, 2023most recent commit 4 months agopypi torchopt} Downloads
Adamp ⭐ 399
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
dependent packages 1total releases 4latest release August 27, 2020most recent commit 3 years agopypi adamp} Downloads
Pytorch_optimizer ⭐ 149
optimizer & lr scheduler & loss function collections in PyTorch
dependent packages 1total releases 63latest release July 19, 2023most recent commit 4 months agopypi pytorch-optimizer} Downloads
The 10 Latest Releases In Deep Learning Optimizer Open Source Projects
Torchopt ⭐ 460
TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
dependent packages 2total releases 14latest release November 10, 2023most recent commit 4 months agopypi torchopt} Downloads
Axon ⭐ 1,381
Nx-powered Neural Networks
dependent packages 5total releases 9latest release August 17, 2023most recent commit 4 months agohex axon} Downloads
Pytorch_optimizer ⭐ 149
optimizer & lr scheduler & loss function collections in PyTorch
dependent packages 1total releases 63latest release July 19, 2023most recent commit 4 months agopypi pytorch-optimizer} Downloads
Jestimator ⭐ 77
Amos optimizer with JEstimator lib.
total releases 5latest release December 05, 2022most recent commit 3 months ago
Golem ⭐ 23
A simple tensor library for the computational graph on CPU
total releases 14latest release October 10, 2022most recent commit a year ago
Adan Pytorch ⭐ 187
Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
total releases 6latest release August 30, 2022most recent commit 2 years ago
Openvino ⭐ 5,316
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
total releases 3latest release November 19, 2021most recent commit 3 months ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.