Asmdb: Understanding and mitigating front-end stalls in warehouse-scale computers

Nayana Prasad Nagendra

Grant Ayers Stanford

David I August

Hyoun Kyu Cho

Svilen Kanev

Christos Kozyrakis Stanford

Trivikram Krishnamurthy

Heiner Litz Stanford

Tipp Moseley

Parthasarathy Ranganathan Google

International Symposium on Computer Architecture (ISCA), 2020


Abstract

It is well known that the datacenters hosting today’s cloud services waste a significant number of cycles on front-end stalls. However, prior work has provided little insights about the source of these front-end stalls and how to address them. This work analyzes the cause of instruction cache misses at a fleet-wide scale and proposes a new compiler-driven software code prefetching strategy to reduce instruction caches misses by 90%.