Awesome Open Source
Awesome Open Source


Bash Script to help statistical tests of Multi-Objective Evolutionary Algorithms.
This Scripts use JMetal Framework 5.2.
Only for Linux Users.
Include another two experiment components for JMetal, see in source code in java.
Another component included in this project is the statistical comparisons, look at: "experiment/MyExperiments/comparison/examples"
But this component can be old, please see this repository.
  1. Use the src in additional files to programming your JMetalMain
    Look at the end of this files for more informations.

  2. Install some programs
    2.1. You need LaTeX - For .tex files
    sudo apt-get install texlive-full
    sudo apt install texlive-latex-base
    sudo apt install texlive-generic-extra
    sudo apt-get install texlive-latex-extra
    sudo apt-get install texlive-science

    2.2. You need R Language - for .R files
    sudo apt-get update
    sudo apt-get install r-base
    sudo apt-get install r-base-dev

    2.3. Install Irace:
    2.4. Install Scatterplot3D, used in new experiment components:
    install.packages("scatterplot3d", repos="")
    2.5. Install PMCMR
    2.6. (optional) Install pdftk, used to merge PDFs
    sudo apt-get install pdftk

  3. Configure
    3.1. Set Benchmark
    3.2. Set Algorithm and its Tag (tag is the name of data files)
    3.3. Set Execution line
    3.4. Set Comparative Line

  4. Execute

  5. Analyse the results in folder: experiment/MyExperiments/Result_$experimentName_$benchmark/

In Additional Folder
Call the for rename data files
It be useful if you had old versions of JMetal and update, then,
all of your data files will be for example "FUN.0", and the new versions use "FUN0.tsv"
If you have this problem, set in this script algorithm and instance to rename.

Rename All files in ".0 .1 .2 ... .max" to ".tsv".

Source: How to read input parameters to execute JMetal with this scripts.
"" is a single runner of algorithm configured by ""
"" can execute several runs and get all data for statistical test
"" configure all tests, algorithms and benchmark
"" read first argument to configure how it will execute

Example of execution:
$ java -jar --statistic ZDT --algorithm NSGAII --algorithm MOEAD --tag test
It will execute NSGAII and MOEAD algorithm in benchmark ZDT, and MOEAD will save its data in "test" folder.

$ java -jar --single-run ZDT1 --algorithm MOEAD
It will execute MOEAD in ZDT1 instance and print the quality indicator at console.

$ java -jar JMetal.jar --comparative UF --algorithm MOEAD --algorithm MOEADDRA
It will generate latex and R files of statistical comparisons using existing data files.

$ java -jar JMetal.jar --indicators UF --algorithm MOEAD
It will execute the indicators of existing data files.

Structure of tests

  • JMetal.jar Put You'r compilation here
  • Additional/
  • src/
  • lib/ Lib of you'r project
  • irace/
  • Irace example using you compilation
  • experiment/
    • MyExperiments/
      • data/

Alternative Project Comparisons
Related Awesome Lists
Top Programming Languages
Top Projects

Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
Java (388,172
R (57,856
Algorithms (37,443
Tex (19,594
Benchmark (11,649
Plot (10,013
Sh (3,348
Evolution (2,475
Tsv (943
Scatter Plot (71
Texlive (70
Statistical Tests (63
Rscript (31
Nsga Ii (29
Moea (11
Moead (9
Jmetal (5
Irace (3
Kruskal Wallis (3