#Semanticcaching - Twitter Hashtag

3 days ago

Learn how a multi-layer semantic cache cut LLM costs by 48% and reduced P95 latency to 1.9s by caching agent planning, summaries, and responses. #semanticcaching #agenticsystems...Show more

hackernoon's tweet photo. Learn how a multi-layer semantic cache cut LLM costs by 48% and reduced P95 latency to 1.9s by caching agent planning, summaries, and responses.
#semanticcaching #agenticsystems...Show more https://t.co/1uU9h8g03G

3

4

1

0

927

CrAIg Walls @habuma

about 1 month ago

Semantic caching can use any vector store. If you’re already using a vector store such as Qdrant, you can use it to speed up semantically similar requests and reduce token usage without adding another database to your stack. #SpringAI #SemanticCaching https://t.co/5Vx9NFYYTu

habuma's tweet photo. Semantic caching can use any vector store. If you’re already using a vector store such as Qdrant, you can use it to speed up semantically similar requests and reduce token usage without adding another database to your stack.

#SpringAI #SemanticCaching

https://t.co/5Vx9NFYYTu https://t.co/8Q36yQZQ2B

0

4

1

181

pgEdge

@pgEdgeInc

5 months ago

🔥New blog: Semantic caching in PostgreSQL with pg_semantic_cache — meaning-based caching that cuts LLM calls and boosts performance. 🚀 Learn how to set it up & see it in action 👇 https://t.co/mFohHQOLGB #Postgres #AI #SemanticCaching #pgEdge #PostgreSQL #SemanticCaching #AI #LLMs #pgEdge #OpenSource #PostgresProfessionals #PostgreSQLDBA

pgEdgeInc's tweet photo. 🔥New blog: Semantic caching in PostgreSQL with pg_semantic_cache — meaning-based caching that cuts LLM calls and boosts performance. 🚀

Learn how to set it up & see it in action 👇
https://t.co/mFohHQOLGB

#Postgres #AI #SemanticCaching #pgEdge

#PostgreSQL #SemanticCaching #AI #LLMs #pgEdge #OpenSource #PostgresProfessionals #PostgreSQLDBA

0

2

1

2

89

InfoQ @InfoQ

8 months ago

Explore how #RetrievalAugmentedGeneration & #SemanticCaching can reduce #FalsePositives in AI-powered apps. Insights come from a production-grade #CaseStudy testing 1,000 queries across 7 bi-encoder models. 📰 Read now: https://t.co/3mhpqjsuhB #AI #LLMs #RAG #VectorDatabases

InfoQ's tweet photo. Explore how #RetrievalAugmentedGeneration & #SemanticCaching can reduce #FalsePositives in AI-powered apps.

Insights come from a production-grade #CaseStudy testing 1,000 queries across 7 bi-encoder models.

📰 Read now: https://t.co/3mhpqjsuhB

#AI #LLMs #RAG #VectorDatabases https://t.co/ozV2NL9blV

0

9

5

2K

Seaflux Technologies @SeafluxTech

over 1 year ago

Optimizing LLMs with #SemanticCaching! ⚡🤖 Discover how this innovative method optimizes performance, reduces costs, and scales AI solutions effectively. 📖 Read: https://t.co/rqKEPetCXS #AI #llm #performanceoptimization #machinelearning