Tag: caching
All the articles with the tag "caching".
Cache the prompt, not the inputs
The key listed the inputs someone believed mattered. The prompt had grown three fields since, and nothing in the system could have noticed.
We built a distributed page cache, then deleted it
Three rounds of tuning to cut the write bill, then removal. The same machinery stayed for images.
Your error handler is inside the cache
A container restart took thirty seconds. The site stayed broken for an hour after it came back.