Putting a model in charge of KV-cache memory Building an RL environment to learn how KV-cache eviction works in LLM serving systems rl · may 04, 2026 Speeding up diffusion models with first block caching How to speed up diffusion inference with minimal quality loss using first block caching diffusion · aug 13, 2025