Optimus Prime: Accelerating Data Transformation in Servers

Modern online services are shifting away from monolithic applications to loosely-coupled microservices because of their improved scalability, reliability, programmability and development velocity. Microservices communicating over the datacenter network require data transformation (DT) to convert messages back and forth between their internal formats. This work identifies DT as a bottleneck due to reductions in latency of the surrounding system components, namely application runtimes, protocol stacks, and network hardware. We therefore propose Optimus Prime (OP), a programmable DT accelerator that uses a novel abstraction, an in-memory schema, to represent DT operations. The schema is compatible with today's DT frameworks and enables any compliant accelerator to perform the transformations comprising a request in parallel. Our evaluation shows that OP's DT throughput matches the line rate of today's NICs and has 60x higher throughput compared to software, at a tiny fraction of the CPU's silicon area and power. We also evaluate a set of microservices running on Thrift, and show up to 30% reduction in service latency.


Publié dans:
Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’20), 1203-1216
Présenté à:
Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems, Lausanne, Switzerland, March 16–20, 2020
Année
2020
Publisher:
New York, NY, USA, ACM
ISBN:
978-1-4503-7102-5/20/03
Mots-clefs:
Autres identifiants:
Laboratoires:


Note: Le statut de ce fichier est: Anyone
Le statut de ce fichier est: Seulement EPFL


 Notice créée le 2020-01-29, modifiée le 2020-04-20

POSTPRINT:
Télécharger le documentPDF
PREPRINT:
Télécharger le documentPDF
Évaluer ce document:

Rate this document:
1
2
3
 
(Pas encore évalué)