We consider an uplink multicarrier system with multiple video users who want to send compressed video data to the base station. In the time domain, we model the time varying channel using Jakes’ model, and in the frequency domain, each subcarrier is assumed to be independently fading. The video is scalably coded in units of group of pictures (GOP), and users have different video rate distortion (RD) functions. At the beginning of the GOP, the base station collects both the RD information and instantaneous channel state information (CSI) for subcarrier allocation purposes. We design a cross layer resource allocation algorithm to assign subcarriers to the users based on both the demand of the video and the quality of the channel. Once the resource allocation decision is made, the users then periodically adapt the modulation format of the subcarriers allocated according to the evolution of the CSI for the duration of the GOP. We show that our cross layer resource allocation robustly outperforms two baseline algorithms, each of which uses only one layer of information for resource allocation.