Research Article: Cost-Aware Load Shedding for Feature APIs
Abstract
We develop a penalty-aware shedder for feature serving that preserves top-line accuracy, improving cost/QPS by 12% at fixed P95.
Cite this article
Davis, D. & Rao, R. (2023). Research Article: Cost-Aware Load Shedding for Feature APIs. Research Explorations in Global Knowledge & Technology (REGKT), 2 (10). Retrieved from https://regkt.com/article.php?id=511&slug=cost-aware-load-shedding-feature-apis