Chasing the "Tail at Scale": Toward Cloud-Native Architectures

Snacks

Refreshments will be served at 3:45 PM.

Abstract 

In this talk, I will present my research efforts to tackle these challenges by designing hardware platforms and software stacks that deliver orders of magnitude improvements in the efficiency of cloud-native workloads. First, I will introduce μManycore, a processor architecture tailored to minimize the tail latency of cloud services. I will then enhance the microarchitecture with Mosaic, which uses fine-grained partitioning of hardware resources to retain service state across frequent context switches. Next, I will integrate many domain-specific accelerators with the processor and introduce AccelFlow, an efficient mechanism for orchestrating these accelerators. Finally, I will showcase EcoFaaS, an energy management framework designed to significantly reduce the energy consumption of cloud-native services on these architectures while maintaining high performance. The combination of all these techniques enables a major advance in the efficiency of cloud-native workloads.

Speaker Bio

Jovan Stojkovic is a final year PhD candidate at the University of Illinois at Urbana-Champaign, advised by Professor Josep Torrellas. His research interests are in hardware and software design for cloud and datacenter workloads. His work appeared in top tier computer architecture conferences, such as ISCA, MICRO, ASPLOS, and HPCA. His research was recognized with the IEEE Micro Top Pick Honorable Mention, Mavis Future Faculty Fellowship, Kenichi Miura Award for excellence in high performance computing, and an invitation to speak at the Heidelberg Laurate Forum. He is an author of six patents filed with IBM and Microsoft.