Maml Pytorch

Elegant PyTorch implementation of paper Model-Agnostic Meta-Learning (MAML)
Alternatives To Maml Pytorch
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Pytorch64,43414616 hours ago23August 10, 202211,492otherC++
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Real Time Voice Cloning40,272
6 days ago104otherPython
Clone a voice in 5 seconds to generate arbitrary speech in real-time
Yolov536,714
19 hours ago35May 21, 2022284gpl-3.0Python
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
Fastai23,60018411717 hours ago143July 04, 2022147apache-2.0Jupyter Notebook
The fastai deep learning library
Pytorch Handbook17,988
6 days ago50Jupyter Notebook
pytorch handbook是一本开源的书籍,目标是帮助那些希望和使用PyTorch进行深度学习开发和研究的朋友快速入门,其中包含的Pytorch教程全部通过测试保证可以成功运行
Ncnn16,742
a day ago19July 01, 2022957otherC++
ncnn is a high-performance neural network inference framework optimized for the mobile platform
Dive Into Dl Pytorch13,747
a year ago76apache-2.0Jupyter Notebook
本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。
Horovod13,13320104 days ago72June 21, 2022344otherPython
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
Deepspeed9,8181217 hours ago53May 25, 2022715mitPython
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Ivy9,816616 hours ago20June 01, 20221,667otherPython
The Unified Machine Learning Framework
Alternatives To Maml Pytorch
Select To Compare


Alternative Project Comparisons
Readme

MAML-Pytorch

PyTorch implementation of the supervised learning experiments from the paper: Model-Agnostic Meta-Learning (MAML).

Version 1.0: Both MiniImagenet and Omniglot Datasets are supported! Have Fun~

Version 2.0: Re-write meta learner and basic learner. Solved some serious bugs in version 1.0.

For Tensorflow Implementation, please visit official HERE and simplier version HERE.

For First-Order Approximation Implementation, Reptile namely, please visit HERE.

heart

Platform

  • python: 3.x
  • Pytorch: 0.4+

MiniImagenet

Howto

For 5-way 1-shot exp., it allocates nearly 6GB GPU memory.

  1. download MiniImagenet dataset from here, splitting: train/val/test.csv from here.
  2. extract it like:
miniimagenet/
├── images
	├── n0210891500001298.jpg  
	├── n0287152500001298.jpg 
	...
├── test.csv
├── val.csv
└── train.csv


  1. modify the path in miniimagenet_train.py:
        mini = MiniImagenet('miniimagenet/', mode='train', n_way=args.n_way, k_shot=args.k_spt,
                    k_query=args.k_qry,
                    batchsz=10000, resize=args.imgsz)
		...
        mini_test = MiniImagenet('miniimagenet/', mode='test', n_way=args.n_way, k_shot=args.k_spt,
                    k_query=args.k_qry,
                    batchsz=100, resize=args.imgsz)

to your actual data path.

  1. just run python miniimagenet_train.py and the running screenshot is as follows: screenshot-miniimagetnet

If your reproducation perf. is not so good, maybe you can enlarge your training epoch to get longer training. And MAML is notorious for its hard training. Therefore, this implementation only provide you a basic start point to begin your research. and the performance below is true and achieved on my machine.

Benchmark

Model Fine Tune 5-way Acc. 20-way Acc.
1-shot 5-shot 1-shot 5-shot
Matching Nets N 43.56% 55.31% 17.31% 22.69%
Meta-LSTM 43.44% 60.60% 16.70% 26.06%
MAML Y 48.7% 63.11% 16.49% 19.29%
Ours Y 46.2% 60.3% - -

Ominiglot

Howto

run python omniglot_train.py, the program will download omniglot dataset automatically.

decrease the value of args.task_num to fit your GPU memory capacity.

For 5-way 1-shot exp., it allocates nearly 3GB GPU memory.

Refer to this Rep.

@misc{MAML_Pytorch,
  author = {Liangqu Long},
  title = {MAML-Pytorch Implementation},
  year = {2018},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/dragen1860/MAML-Pytorch}},
  commit = {master}
}
Popular Pytorch Projects
Popular Gpu Projects
Popular Machine Learning Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pytorch
Gpu