We present a system dedicated to the real-time production of multimedia products and TV shows involving multiple virtual actors and presenters. This system, named VHD (virtual human director), may also be used for character animation on high-level systems and interaction with Web-based applications. The user can create virtual stories by directing all actions in real time. It is similar to a movie producer directing actors during filming but with more control given to the director in the sense that everything is decided and controlled by the same person. To make this complicated task possible, in a useable way, we based the interaction on the high-level control of the virtual actor