Extreme events in the stratospheric polar vortex can lead to changes in the tropospheric circulation and impact the surface climate on a wide range of timescales. The austral stratospheric vortex shows its largest variability in spring, and a weakened polar vortex is associated with changes in the spring to summer surface climate, including hot and dry extremes in Australia. However, the robustness and extent of the connection between polar vortex strength and surface climate on interannual timescales remain unclear. We assess this relationship by using reanalysis data and time-slice simulations from two chemistry-climate models (CCMs), building on previous work that is mainly based on observations. The CCMs show a similar downward propagation of anomalies in the polar vortex strength to the reanalysis data: a weak polar vortex is on average followed by a negative tropospheric Southern Annular Mode (SAM) in spring to summer, while a strong polar vortex is on average followed by a positive SAM. The signature in the surface climate following polar vortex weakenings is characterized by high surface pressure and warm temperature anomalies over Antarctica, the region where surface signals are most robust across all model and observational datasets. However, the tropospheric SAM response in the two CCMs considered is inconsistent with observations. In one CCM, the SAM is more negative compared to the reanalysis after weak polar vortex events, whereas in the other CCM, it is less negative. In addition, neither model reproduces all the regional changes in midlatitudes, such as the warm and dry anomalies over Australia. We find that these inconsistencies are linked to model biases in the basic state, such as the latitude of the eddy-driven jet and the persistence of the SAM. These results are largely corroborated by models that participated in the Chemistry-Climate Model Initiative (CCMI). Furthermore, bootstrapping of the data reveals sizable uncertainty in the magnitude of the surface signals in both models and observations due to internal variability. Our results demonstrate that anomalies of the austral stratospheric vortex have significant impacts on surface climate, although the ability of models to capture regional effects across the Southern Hemisphere is limited by biases in their representation of the stratospheric and tropospheric circulation.