PermutationTest

Using Permutation Test to compare the performance of two optimization algorithms.

Many metaheuristic approaches are inherently stochastic. In order to compare such methods, statistical tests are needed. However, choosing an appropriate test is not trivial, given that each test has some assumptions about the distribution of the underlying data that must be true before it can be used. Permutation tests (P-Tests) are statistical tests with minimal number of assumptions. These tests are simple, intuitive and nonparametric.

Mathematics | Free Full-Text | Permutation Tests for Metaheuristic Algorithms (mdpi.com)