Case Study: Latency-SLO Shielding for Feature Serving
Abstract
A fintech added queue disciplines and fallback caches to shield P99 SLOs for online features, improving tail latency by 16%.
Cite this article
Jackson, M., Gonzalez, E., & Zhang, M. (2024). Case Study: Latency-SLO Shielding for Feature Serving. Research Explorations in Global Knowledge & Technology (REGKT), 3 (12). Retrieved from https://regkt.com/article.php?id=369&slug=case-study-latency-slo-shielding-feature-serving