Cortical sensory areas are supposed to encode immediate sensory inputs. In this issue of Neuron, Condylis et al. (2020) show that they can also recall information about a past event when in need of comparing two temporally segregated sensory inputs.