The design of efficient locomotion gaits for robots with many degrees of freedom is challenging and time con- suming even if optimization techniques are applied. Control parameters can be found through optimization in two ways: (i) through online optimization where the performance of a robot is measured while trying different control parameters on the actual hardware and (ii) through offline optimization by simulating the robot’s behavior with the help of models of the robot and its environment. In this paper, we present a hybrid optimization method that combines the best properties of online and offline optimization to efficiently find locomotion gaits for arbitrary structures. In comparison to pure online optimization both the number of experiments using robotic hardware as well as the total time required for finding efficient locomotion gaits get highly reduced by running the major part of the optimization process in simulation using a cluster of processors. The presented example shows that even for robots with a low number of degrees of freedom the time required for optimization can be reduced by at least a factor of 2.5 to 30 depending on how extensive the search for optimized control parameters should be. Time for hardware experiments becomes minimal. More importantly gaits that can possibly damage the robotic hardware can be filtered before being tried. Yet in contrast to pure offline optimization we reach well matched behavior that allows a direct transfer of locomotion gaits from simulation to hardware. This is because through a meta-optimization we adapt not only the locomotion parameters but also the parameters for simulation models of the robot and environment allowing for a good matching of the behavior of simulated and hardware robot structures. We verify the proposed hybrid optimization method on a structure composed of two Roombots modules. Roombots are self-reconfigurable modular robots that can form arbitrary structures with many degrees of freedom through an integrated active connection mechanism.