Latency on Subhajai Benchadhikulhttps://subhajai.benchadhikul.com/tags/latency/Recent content in Latency on Subhajai BenchadhikulHugoen-usWed, 15 Jul 2026 07:00:00 +0700Semantic Caching: The Cheapest AI Answer Is the One You Don't Regeneratehttps://subhajai.benchadhikul.com/posts/2026-07-15-technology-semantic-caching-ai/Wed, 15 Jul 2026 07:00:00 +0700https://subhajai.benchadhikul.com/posts/2026-07-15-technology-semantic-caching-ai/Traditional caches only recognise a question they’ve seen letter for letter. Semantic caching recognises meaning — and for the thousandth shopper asking ‘does this run small?’ in slightly different words, that difference is most of your bill.