Atum: Scalable Group Communication Using Volatile Groups

This paper presents Atum, a group communication middleware for a large, dynamic, and hostile environment. At the heart of Atum lies the novel concept of volatile groups: small, dynamic groups of nodes, each executing a state machine replication protocol, organized in a flexible overlay. Using volatile groups, Atum scatters faulty nodes evenly among groups, and then masks each individual fault inside its group. To broadcast messages among volatile groups, Atum runs a gossip protocol across the overlay. We report on our synchronous and asynchronous (eventually synchronous) implementations of Atum, as well as on three representative applications that we build on top of it: A publish/subscribe platform, a file sharing service, and a data streaming system. We show that (a) Atum can grow at an exponential rate beyond 1000 nodes and disseminate messages in polylogarithmic time (conveying good scalability); (b) it smoothly copes with 18% of nodes churning every minute; and (c) it is impervious to arbitrary faults, suffering no performance decay despite 5.8% Byzantine nodes in a system of 850 nodes.

Published in:
Proceedings of the 17th International Middleware Conference - Middleware '16, 1-14
Presented at:
17th International Middleware Conference, Trento, Italy, 12-16 December 2016
New York, New York, USA, ACM Press

Note: The status of this file is: Anyone

 Record created 2016-12-14, last modified 2020-07-29

Download fulltext

Rate this document:

Rate this document:
(Not yet reviewed)