Optimus Prime: Accelerating Data Transformation in Servers

Modern online services are shifting away from monolithic applications to loosely-coupled microservices because of their improved scalability, reliability, programmability and development velocity. Microservices communicating over the datacenter network require data transformation (DT) to convert messages back and forth between their internal formats. This work identifies DT as a bottleneck due to reductions in latency of the surrounding system components, namely application runtimes, protocol stacks, and network hardware. We therefore propose Optimus Prime (OP), a programmable DT accelerator that uses a novel abstraction, an in-memory schema, to represent DT operations. The schema is compatible with today's DT frameworks and enables any compliant accelerator to perform the transformations comprising a request in parallel. Our evaluation shows that OP's DT throughput matches the line rate of today's NICs and has 60x higher throughput compared to software, at a tiny fraction of the CPU's silicon area and power. We also evaluate a set of microservices running on Thrift, and show up to 30% reduction in service latency.


Published in:
Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’20), 1203-1216
Presented at:
Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems, Lausanne, Switzerland, March 16–20, 2020
Year:
2020
Publisher:
New York, NY, USA, ACM
ISBN:
978-1-4503-7102-5/20/03
Keywords:
Other identifiers:
Laboratories:


Note: The status of this file is: Anyone
The status of this file is: EPFL only


 Record created 2020-01-29, last modified 2020-10-25

POSTPRINT:
Download fulltextPDF
PREPRINT:
Download fulltextPDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)