The anthrax toxin is a tripartite toxin, where the two enzymatic subunits require the third subunit, the protective antigen (PA), to interact with cells and be escorted to their cytoplasmic targets. PA binds to cells via one of two receptors, TEM8 and CMG2. Interestingly, the toxin times and triggers its own endocytosis, in particular through the heptamerization of PA. Here we show that PA triggers the ubiquitination of its receptors in a beta-arrestin-dependent manner and that this step is required for clathrin-mediated endocytosis. In addition, we find that endocytosis is dependent on the heterotetrameric adaptor AP-1 but not the more conventional AP-2. Finally, we show that endocytosis of PA is strongly dependent on actin. Unexpectedly, actin was also found to be essential for efficient heptamerization of PA, but only when bound to one of its 2 receptors, TEM8, due to the active organization of TEM8 into actin-dependent domains. Endocytic pathways are highly modular systems. Here we identify some of the key players that allow efficient heptamerization of PA and subsequent ubiquitin-dependent, clathrin-mediated endocytosis of the anthrax toxin.