Research Article: Incremental Compaction for Lakehouse CDC Tables
Abstract
We propose a lateness-aware compaction scheduler that respects watermark jitter and hot partitions, cutting read amplification by 18% in production.
Cite this article
Garcia, Z., Chen, A., & Wright, Z. (2024). Research Article: Incremental Compaction for Lakehouse CDC Tables. Research Explorations in Global Knowledge & Technology (REGKT), 3 (12). Retrieved from https://regkt.com/article.php?id=306&slug=incremental-compaction-lakehouse-cdc-tables