Comparison-Based Optimizers Need Comparison-Based Surrogates
Taking inspiration from approximate ranking, this paper nvestigates the use of rank-based Support Vector Machine as surrogate model within CMA-ES, enforcing the invariance of the approach with respect to monotonous transformations of the fitness function. Whereas the choice of the SVM kernel is known to be a critical issue, the proposed approach uses the Covariance Matrix adapted by CMA-ES within a Gaussian kernel, ensuring the adaptation of the kernel to the currently explored region of the fitness landscape at almost no computational overhead. The empirical validation of the approach on standard benchmarks, comparatively to CMA-ES and recent surrogate-based CMA-ES, demonstrates the efficiency and scalability of the proposed approach.
PPSN2010_ACM-ES.pdf
openaccess
154.43 KB
Adobe PDF
cfbb5c12d6094cbc5e449c4f1846bb2f