Awesome Open Source

Programming Languages

Search results for sgd

318 search results found

Machinelearning ⭐ 4,895

Basic Machine Learning and Deep Learning

Fairscale ⭐ 2,734

PyTorch extensions for high performance and large scale training.

Adabound ⭐ 2,732

An optimizer that trains as fast as Adam and as good as SGD.

Awd Lstm Lm ⭐ 1,838

LSTM and QRNN Language Model Toolkit for PyTorch

SAM: Sharpness-Aware Minimization (PyTorch)

Tribuo ⭐ 1,202

Tribuo - A Java machine learning library

Notes ⭐ 1,028

fastFM: A Library for Factorization Machines

Tf Recomm ⭐ 882

Tensorflow-based Recommendation systems

Hands On Meta Learning With Python ⭐ 857

Learning to Learn using One-Shot Learning, MAML, Reptile, Meta-SGD and more with Tensorflow

Stochastic Weight Averaging in PyTorch

Randwirenn ⭐ 663

Implementation of: "Exploring Randomly Wired Neural Networks for Image Recognition"

Dist Keras ⭐ 611

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Gradient Centralization ⭐ 497

A New Optimization Technique for Deep Neural Networks

Go Deep ⭐ 436

Artificial Neural Network

Deep_learning_nlp ⭐ 359

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

Sfdx Git Delta ⭐ 359

Generate the sfdx content in source format from two git commits

Nfnets Pytorch ⭐ 316

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

Awesome Distributed Deep Learning ⭐ 309

A curated list of awesome Distributed Deep Learning resources.

Deepnet ⭐ 267

Implementations of CNNs, RNNs and deep learning techniques in pure Numpy

Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.

Face Generator ⭐ 244

Generate human faces with neural networks

Lightnet ⭐ 236

Efficient, transparent deep learning in hundreds of lines of code.

Gan_numpy ⭐ 234

Machine Learning In Action ⭐ 226

个人使用jupyter notebook整理的peter的《机器学习实战》代码，使其更有层次感，更加连贯，也加了一些自己的修

Lightweight Segmentation ⭐ 225

Lightweight models for real-time semantic segmentation(include mobilenetv1-v3, shufflenetv1-v2, igcv3, efficientnet).

Cnn Numpy ⭐ 219

Inplement an CNN frame with Numpy, easy to learn, hard to use hhhh

Spark Fm Parallelsgd ⭐ 212

Implementation of Factorization Machines on Spark using parallel stochastic gradient descent (python and scala)

Keras_insightface ⭐ 208

Insightface Keras implementation

Implements pytorch code for the Accelerated SGD algorithm.

Ml From Scratch ⭐ 188

All the ML algorithms, ML models are coded from scratch by pure Python/Numpy with the Math under the hood. It works well on CPU.

Mlbasic ⭐ 183

深度学习常用优化方法详解

Sgdlibrary ⭐ 181

MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20

Neural Language Model ⭐ 180

Implementation of neural language models, in particular Collobert + Weston (2008) and a stochastic margin-based version of Mnih's LBL.

Theano Hf ⭐ 180

General purpose Hessian-free optimization in Theano

Ml_algo ⭐ 171

Machine learning algorithms in Dart programming language

Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization

Keras Adamw ⭐ 159

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

Fairdarts ⭐ 153

Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search

Terngrad ⭐ 152

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

Keras Fractalnet ⭐ 146

FractalNet implementation in Keras: Ultra-Deep Neural Networks without Residuals

Stochastic_gradient_push ⭐ 141

Stochastic Gradient Push for Distributed Deep Learning

Pytorch1.0 Cn ⭐ 139

PyTorch 1.0 官方文档中文版，欢迎关注微信公众号：磐创AI

Mobilenetv2 ⭐ 137

End To End Generative Dialogue ⭐ 135

A neural conversation model

Adabound Tensorflow ⭐ 135

Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)

Crowded Valley Results ⭐ 129

This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"

Bilevel Optimization Library in Python for Multi-Task and Meta Learning

Ftrl_proximal_lr ⭐ 123

Multithreaded Asynchronous FTRL Proximal Implementation

Fitting Random Labels ⭐ 118

Example code for the paper "Understanding deep learning requires rethinking generalization"

Equi-normalization of Neural Networks

Jiro Nn ⭐ 113

A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.

Powersgd ⭐ 112

Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727

Scala library for neural networks

Deep Learning ⭐ 107

personal practice（个人练习，实现了深度学习中的一些算法，包括：四种初始化方法（zero initialize, random initialize, xavier initialize, he initialize），深度神经网络，正则化，dropout，三种梯度下降方法(BGD, SGD, mini-batch)，六种优化算法(momentum、nesterov momentum、Adagrad、Adadelta、RMSprop、Adam)，梯度检验、batch normalization）、RNN

Torchmpi ⭐ 106

Implements a message passing interface (MPI) wrapper that makes it easy to do massively parallel computations inside the Torch deep-learning framework.

Distributeddeeplearningreads ⭐ 105

Papers and blogs related to distributed deep learning

Ffm_mpi ⭐ 101

LR、FM model solved by ftrl and sgd parallel on MPI

Fairseq Apollo ⭐ 98

FairSeq repo with Apollo optimizer

Pytorch Byol ⭐ 94

PyTorch implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning

Adaptive Inertia Adai ⭐ 94

The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our ICML2022 Oral paper: "Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum".

TensorFlow implementation of COCOB

Akkadistbelief ⭐ 85

An implementation of DistBelief using the Akka Actor framework

Nlp Interview Notes ⭐ 84

📚 专门为自然语言处理(NLP)面试准备的学习笔记与资料

Tensorflow implementation of "Learning to Balance: Bayesian Meta-learning for Imbalanced and Out-of-distribution Tasks" (ICLR 2020 oral)

Mobilenet V2 ⭐ 72

Repository for "Inverted Residuals and Linear Bottlenecks: Mobile Networks for Classification, Detection and Segmentation".

Torchlars ⭐ 68

A LARS implementation in PyTorch

Train the SGD model to recognize MNIST handwritten digits on local device

Cumf_sgd ⭐ 62

CUDA Matrix Factorization Library with Stochastic Gradient Descent (SGD)

Entropy Sgd ⭐ 61

Lua implementation of Entropy-SGD

Fastfm Core ⭐ 61

A short paper describing the library is available on arXiv.

Meta Sgd ⭐ 60

Meta-SGD experiment on Omniglot classification compared with MAML

Accentor ⭐ 56

Data & Code for ACCENTOR: "Adding Chit-Chat to Enhance Task-Oriented Dialogues" (NAACL 2021)

Theano Mpi ⭐ 55

MPI Parallel framework for training deep learning models built in Theano

Batchnorm Pruning ⭐ 54

Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers https://arxiv.org/abs/1802.00124

Ctr Criteo ⭐ 54

kaggle 2014 criteo ctr竞赛方案整理 https://www.kaggle.com/c/criteo-display-ad-challen

Fuck Sjtu Ml Exam ⭐ 53

该仓库面向SJTU SE-125 机器学习的期末考试.这个仓库主要记录了个人根据老师提供的考纲文档整理的笔记。其中大部分都是根据文档上网查阅资料并copy的，夹带有一定私货。仓库中整理的文档与老师上课的slides关系不大（因为我真的看不懂那么多公式推导）。希望这些文档可以

An R package for large scale estimation with stochastic gradient descent

Meta Sgd Pytorch ⭐ 53

Neat implementation of Meta-SGD in pytorch: https://arxiv.org/abs/1707.09835

Implementation of the Deep Frank-Wolfe Algorithm -- Pytorch

Torch Inception Resnet V2 ⭐ 52

The inception-resnet-v2 models re-trained from scratch via torch

Riemannian stochastic optimization algorithms: Version 1.0.3

Distributed Learning by Pair-Wise Averaging

Keras2ios ⭐ 50

Run Keras Deep Learning Models (basic case) with CoreMLTools for iOS 11

Synapses ⭐ 50

R/Rcpp implementation of the 'Follow-the-Regularized-Leader' algorithm

Neural Net Optimization ⭐ 49

PyTorch implementations of recent optimization algorithms for deep learning.

Parallelizing Stochastic Gradient Descent for Deep Convolutional Neural Network

Code for the signSGD paper

Kfac Pytorch ⭐ 47

Pytorch implementation of KFAC and E-KFAC (Natural Gradient).

Sgd Influence ⭐ 47

Python codes for influential instance estimation

Add layer-wise learning rate schemes to Torch

Linkos Android Samples ⭐ 46

Java based sample code for developing on Android. The demos in this repository are stored on separate branches. To navigate to a demo, please click branches.

[outdated] Beatmania IIDX and Sound Voltex hybrid controller

Knittingboar ⭐ 43

Parallel Iterative Algorithm (SGD) on Hadoop's YARN framework

Mnasnet Pytorch ⭐ 42

A PyTorch implementation of MNASNET

Numpy Neuralnet Exercise ⭐ 42

Implementation of key concepts of neuralnetwork via numpy

Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".

Retinanet Mxnet ⭐ 41

An unofficial implementation of ICCV 2017 RetinaNet (Focal Loss).

1-100 of 318 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.