Deep Neuroevolution

Alternatives To Deep Neuroevolution
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Deep Neuroevolution1,502
2 years ago17otherPython
Deep Neuroevolution
Sparse Evolutionary Artificial Neural Networks187
2 years agomitPython
Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).
Awesome Deep Neuroevolution111
2 years ago1apache-2.0
A collection of Deep Neuroevolution resources or evolutionary algorithms applying in Deep Learning (constantly updating)
Tensorflow Neuroevolution109
3 months ago5September 03, 202021apache-2.0Python
Neuroevolution Framework for Tensorflow 2.x focusing on modularity and high-performance. Preimplements NEAT, DeepNEAT, CoDeepNEAT, etc.
Neuroevolution67
2 years ago2mitPython
Neuroevolution as a direct policy search deep reinforcement learning method, implemented using Keras and DEAP.
Denser Models47
5 years ago1lgpl-3.0Python
Neft Godot39
2 years agon,ullmitGDScript
Neuroevolution of Fixed Topology for Godot
Cerebrum24
2 years agoapache-2.0JavaScript
Cerebrum.js is a neural network library created in pure JavaScript.
Es_pytorch20
a year ago7Python
High performance implementation of Deep neuroevolution in pytorch using mpi4py. Intended for use on HPC clusters
Galapagos_nao20
5 years ago12mitElixir
A playground for continual, interactive neuroevolution
Alternatives To Deep Neuroevolution
Select To Compare


Alternative Project Comparisons
Readme

AI Labs Neuroevolution Algorithms

This repo contains distributed implementations of the algorithms described in:

[1] Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning

[2] Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agents

Our code is based off of code from OpenAI, who we thank. The original code and related paper from OpenAI can be found here. The repo has been modified to run both ES and our algorithms, including our Deep Genetic Algorithm (DeepGA) locally and on AWS.

Note: The Humanoid experiment depends on Mujoco. Please provide your own Mujoco license and binary

The article describing these papers can be found here

Visual Inspector for NeuroEvolution (VINE)

The folder ./visual_inspector contains implementations of VINE, i.e., Visual Inspector for NeuroEvolution, an interactive data visualization tool for neuroevolution. Refer to README.md in that folder for further instructions on running and customizing your visualization. An article describing this visualization tool can be found here.

Accelerated Deep Neurevolution

The folder ./gpu_implementation contains an implementation that uses GPU more efficiently. Refer to README.md in that folder for further instructions.

How to run locally

clone repo

git clone https://github.com/uber-common/deep-neuroevolution.git

create python3 virtual env

python3 -m venv env
. env/bin/activate

install requirements

pip install -r requirements.txt

If you plan to use the mujoco env, make sure to follow mujoco-py's readme about how to install mujoco correctly

launch redis

. scripts/local_run_redis.sh

launch sample ES experiment

. scripts/local_run_exp.sh es configurations/frostbite_es.json  # For the Atari game Frostbite
. scripts/local_run_exp.sh es configurations/humanoid.json  # For the MuJoCo Humanoid-v1 environment

launch sample NS-ES experiment

. scripts/local_run_exp.sh ns-es configurations/frostbite_nses.json
. scripts/local_run_exp.sh ns-es configurations/humanoid_nses.json

launch sample NSR-ES experiment

. scripts/local_run_exp.sh nsr-es configurations/frostbite_nsres.json
. scripts/local_run_exp.sh nsr-es configurations/humanoid_nsres.json

launch sample GA experiment

. scripts/local_run_exp.sh ga configurations/frostbite_ga.json  # For the Atari game Frostbite

launch sample Random Search experiment

. scripts/local_run_exp.sh rs configurations/frostbite_ga.json  # For the Atari game Frostbite

visualize results by running a policy file

python -m scripts.viz 'FrostbiteNoFrameskip-v4' <YOUR_H5_FILE>
python -m scripts.viz 'Humanoid-v1' <YOUR_H5_FILE>

extra folder

The extra folder holds the XML specification file for the Humanoid Locomotion with Deceptive Trap domain used in https://arxiv.org/abs/1712.06560. Use this XML file in gym to recreate the environment.

How to run in docker container

You can also run the code inside a docker container using docker and docker-compose.

See https://docs.docker.com/get-started/ for an introduction to docker.
See also https://docs.docker.com/compose/overview/ for an introduction to docker-compose.

Clone repo and enter the directory.

git clone https://github.com/uber-common/deep-neuroevolution.git
cd deep-neuroevolution

Start the container launching the redis instance, use sudo if required, see also this page.

sudo docker-compose up

Open up a second terminal session into the container.

sudo docker exec -it deepneuro /bin/bash

Start the experiment of your choice as stated above. E.g.

cd ~/deep-neuroevolution/
. scripts/local_run_exp.sh es configurations/frostbite_es.json
Popular Neuroevolution Projects
Popular Deep Learning Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Docker
Machine Learning
Deep
Algorithms
Ai
Reinforcement Learning
Mujoco
Neuroevolution