Uncertainties in design variables and problem parameters are often inevitable and must be considered in an optimization task if reliable optimal solutions are sought. Besides a number of sampling techniques, there exist several mathematical approximations of a solution’s reliability. These techniques are coupled in various ways with optimization in the classical reliability-based optimization field. This paper demonstrates how classical reliability-based concepts can be borrowed and modified and, with integrated single and multiobjective evolutionary algorithms, used to enhance their scope in handling uncertainties involved among decision variables and problem parameters. Three different optimization tasks are discussed in which classical reliability-based optimization procedures usually have difficulties, namely 1) reliabilitybased optimization problems having multiple local optima, 2) finding and revealing reliable solutions for different reliability indices simultaneously by means of a bi-criterion optimization approach, and 3) multiobjective optimization with uncertainty and specified system or component reliability values. Each of these optimization tasks is illustrated by solving a number of test problems and a well-studied automobile design problem. Results are also compared with a classical reliability-based methodology.