SimFog @FogSim

GPTCache Creator | Milvus Engineer @milvusio Joined May 2022

Tweets

74
Followers

65
Following

41
Likes

80

Zilliz @zilliz_universe

2 years ago

Be the first to know about major Zilliz Cloud updates on January 30! Follow along on Twitter until February 8 for some exciting surprises 🎉 #ZillizCloudLaunch

0 8 15 789 0

View Details

SimFog @FogSim

3 years ago

@sumanth_27_1997 @langchain @zilliz_universe it will be fixed in the recent days. Because I am developing a new milvu feature recently

1 0 3 73 0

View Details

Hi, all. The latest version of GPTCache has support the weaviate @weaviate_io vector database. Big thanks to @pranay_chandekr for his support !!! Next, what features do you expect in GPTCache?🙌 github.com/zilliztech/GPT…

2 2 9 755 0

View Details

SimFog @FogSim

3 years ago

@theomitsa @JagersbergKnut @chidambara09 Very happy that GPTCache can be of assistance to you. 👏

0 0 2 22 0

View Details

Dr. Theophano Mitsa ☦️🇬🇷🇺🇸 @theomitsa

3 years ago

github.com/zilliztech/GPT… Use caching to save money for your LLMs! #MachineLearning, #DataScience @JagersbergKnut @chidambara09

2 7 10 610 0

View Details

Shivansh Kaushik @shivansh_k_

3 years ago

Check out my article that explains the usage and benefits of GPTCache in depth and make the most out of this brilliant service. #gptcache #llms #OpenAI medium.com/@shivansh.kaus…

1 2 4 137 0

View Details

SimFog @FogSim

3 years ago

@AlphaSignalAI The latest version of GPTCache, has added a `report` table, which means you can use it analyze cache hits.

0 1 6 500 0

View Details

Lior Alexander @LiorOnAI

3 years ago

You can cut your GPT API expenses by 50% through caching using LangChain and GPTCache. GPTCache uses embedding algorithms to convert queries into embeddings and uses a vector store for similarity search on these embeddings. This process allows GPTCache to identify and retrieve similar or related queries from the cache storage. You will also benefit from significant response time increase and API rate limit restrictions. pip install gptcache

17 111 558 123K 559

View Details

SimFog @FogSim

3 years ago

Recently, I have received many inquiries about GPTCache and milvus from the community, such as Walmart! If you are also building an LLM-related product, I believe GPTCache and milvus can make it more attractive !!! @milvusio @zilliz_universe

0 0 4 73 0

View Details

SimFog @FogSim

3 years ago

A new report table has also been introduced, enabling users to analyze the access status of the cache more effectively!!!

0 0 0 29 0

View Details

SimFog @FogSim

3 years ago

In the latest version of GPTCache, an additional option for cache storage has been added, which is redis that also supports as the vector store. Along with this, ... github.com/zilliztech/GPT…

1 0 2 67 0

View Details

SimFog @FogSim

3 years ago

Thank you very much for your support of Milvus and GPTCache. If you encounter any problems while using GPTCache, please feel free to give us your feedback. We are also excited to hear about your experience with using GPTCache in your products. github.com/zilliztech/gpt…

agentnative @agentnativedev

3 years ago

Curious about how your @langchain app can scale to millions of users without missing a beat?🌍 Smart implementation of the cache is one of the key aspects! I have got another very simple, step-by-step mini-course to show you how @langchain can leverage GPTCache to -

13 94 408 119K 565

1 1 6 521 0

View Details

SimFog @FogSim

3 years ago

What features do you anticipate adding in the next version? Feel free to submit an issue to me. Additionally, I would be delighted to hear about your experience using GPTCache.

0 0 2 36 0

View Details

SimFog @FogSim

3 years ago

Great news! A new version of GPTCache has just been released! This latest version includes new features such as the Qdrant vector store and the Mongodb cache store. And, some functions have been optimized based on feedback from the community. github.com/zilliztech/GPT…

1 0 4 98 1

View Details

SimFog @FogSim

3 years ago

@rohanpaul_ai @langchain Additionally, the community has contributed to expanding the types of supported stores, including Qdrant, MongoDB, and Redis. github.com/zilliztech/GPT…

0 0 3 183 0

View Details

SimFog @FogSim

3 years ago

@rohanpaul_ai @shanghaikid @langchain Thank you very much for your support. Currently, GPTCache has made significant efforts in improving the quality of cached answers through similarity evaluation using technologies such as Cohere Rerank API, SBERT Cross Encoder, etc.

1 0 3 358 0

View Details

Rohan Paul @rohanpaul_ai

3 years ago

Massive cost saving (by 50% or more 💵📷) of your ChatGPT API call by using caching with @langchain and GPTCache Integration. 🚀 Also much faster response times 📷 🚀 Overcoming the rate limits restrictions 🚀 Greatly enhance the scalability of your application, by reducing the load on the LLM service. 🚀 GPTCache first performs embedding operations on the input to obtain a vector and then conducts a vector approximation search in the cache storage. 🚀 After receiving the search results, it performs a similarity evaluation and returns when the set threshold is reached. You can adjust the threshold which will change the accuracy of its fuzzy search results. ⏰ If you enjoyed this post: 1. Follow me @rohanpaul_ai for more of this every day and 2. Like & Retweet this tweet: Also, check out my MachineLearning YouTube channel youtube.com/@RohanPaul-AI #opensource #LLM #vectorstore #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #langchain