Augmented Reality enhances the user perception by overlaying real world information with virtual computer-generated information. The aims of the 6 th Sense pro ject are to maximize the user experience in mobile Augmented Reality and to improve the context-aware real-time interaction between the real environment and the virtual world. To achieve these ob jectives a generic framework has been proposed.The framework is constituted of two main layers: End-to-End Quality of Perception Adaptation Layer and Generic Augmented Reality Layer. In order to achieve the best possible user experience, the end-to-end adaptation layer adapts the controllable parameters of the Augmented Reality infrastructure in real-time in function of the operating conditions parameters such as transmission link and users head motion. The generic Augmented Reality layer encompasses solutions to the problem of overlaying adequate information in the real scene and manages multimodal interaction with the virtual environment.