The coupling of a prescribed number of site-controlled pyramidal quantum dots (QDs) with photonic crystal (PhC) cavities was studied by polarization and power-dependent photoluminescence measurements. The energy of the cavity mode could be readily tuned, making use of the high spectral uniformity of the QDs and designing PhC cavities with different hole radii. Efficient coupling of the PhC cavity modes both to the ground state and to the excited state transitions of the QDs was observed, whereas no evidence for far off-resonant coupling was found.