gym-forex

The Forex environment is a forex trading simulator for OpenAI Gym, allowing to test the performace of a custom trading agent. Featuring: configurable initial capital, dynamic or dataset-based spread, CSV history timeseries for trading currencies and observations for the agent, fixed or agent-controlled take-profit, stop-loss and order volume.

The environment features discrete action spaces and optionally continuous action spaces if the orders dont have fixed take-profit/stop-loss and order volume.

Installation

Step 1 - Setup Dependencies

Install Python, pip, OpenAI Gym and other dependencies:

sudo apt-get install -y python3-numpy python3-dev cmake zlib1g-dev libjpeg-dev xvfb ffmpeg libboost-all-dev libsdl2-dev python3-pip git gcc make perl

pip3 install graphviz neat-python gitpython gym neat-python matplotlib requests

Step 2 - Get gym-forex from GitHub

git clone harveybc/gym-fx

Step 3 - Set the PYTHONPATH variable

Set the PYTHONPATH environment variable, you may add the following line to the .profile file in your home directory to export on start of sessions. Replace with your username.

• Linux:

export PYTHONPATH=/home/username/gym-fx/:${PYTHONPATH}

• Windows:

set PYTHONPATH="c:\Users\username\gym-fx";%PYTHONPATH%

Step 4 - Setup gym-forex

cd gym-fx

python setup.py install

Step 5 - Start your agent optimizer that uses the gym-forex environment.

-Linux:

sh ./optimize.sh

-Windows:

optimize.bat

Step 6 - Optional: Configure the NEAT parameters

'nano agents/config_20'

Configure in the file, the population size and other parameters according to your computing capacity or requirements, start with the defaults.

Observation Space

A concatenation of num_ticks vectors for the lastest: vector of values from timeseries, equity and its variation, order_status( -1=closed,1=opened),time_opened (normalized with max_order_time), order_profit and its variation, order_drawdown /order_volume_pips, consecutive_drawdown/max_consecutive_dd

Action Space

discrete action 0: 0=nop,1=close,2=buy,3=sell
discrete action 0 parameter: symbol
(optional) continuous action 0 parameter: percent_tp, percent_sl,percent_max

Reward Function

The reward function is the average of the area under the curve of equity and the balance variation.

MQL4 Dataset Generator

Download and install Metatrader 4.

• Mac

Navigate to Library -> Application -> Support -> MetaTrader 4 -> Bottles -> metatrader64 -> drive_c -> Program Files(x86) -> MetaTrader 4 > MQL4.

Copy the *.mq4 files from datasets into the Scripts folder.

To run these scripts, open MT4 and in the Navigator pane, run the scripts under the "Scripts" folder. Right click the file and click Modify. Run, edit, and debug scripts here as you see fit. The .csv files generated with these scripts will appear in Files.

• Windows

On MT4: File-> Open Data folder -> MQL4.