The engineering of the three-dimensional (3D) heterostructure potential in GaAs/AlGaAs pyramidal quantum dot-in-dots (DiDs) provides control over the valence band symmetry and hence on the polarization of the emitted photons. We propose a technique for dynamic switching of hole character and photon polarization in DiDs by means of an applied electric field. The structural parameters required for producing this effect are discussed. Asymmetric DiDs are found to be particularly suitable for obtaining switching with fields smaller than 1 kV cm(-1). The proposed device enables generation of single photons with dynamic control on the photon polarization, with potential applications in quantum information technology.