Performance Optimizations Can Have Unexpectedly Large Effects When Combined With Caches
Performance Optimizations Can Have Unexpectedly Large Effects When Combined With Caches This post is about a non-obvious interaction between performance optimizations and LRU/time limited caching. In 2017, I was working a major performance issue. We were onboarding a large customer, and a batch proc...
Hasnain says:
"It's common wisdom that systems with caches can fail badly when the caches are cold. When every request misses the cache, the system is overloaded, and never recovers. What I observed was the mirror image."
Posted on 2022-11-15T04:47:16+0000