SimFog @FogSim
GPTCache Creator | Milvus Engineer @milvusio Joined May 2022-
Tweets74
-
Followers65
-
Following41
-
Likes80
Be the first to know about major Zilliz Cloud updates on January 30! Follow along on Twitter until February 8 for some exciting surprises 🎉 #ZillizCloudLaunch
@sumanth_27_1997 @langchain @zilliz_universe it will be fixed in the recent days. Because I am developing a new milvu feature recently
Hi, all. The latest version of GPTCache has support the weaviate @weaviate_io vector database. Big thanks to @pranay_chandekr for his support !!! Next, what features do you expect in GPTCache?🙌 github.com/zilliztech/GPT…
@theomitsa @JagersbergKnut @chidambara09 Very happy that GPTCache can be of assistance to you. 👏
github.com/zilliztech/GPT… Use caching to save money for your LLMs! #MachineLearning, #DataScience @JagersbergKnut @chidambara09
Check out my article that explains the usage and benefits of GPTCache in depth and make the most out of this brilliant service. #gptcache #llms #OpenAI medium.com/@shivansh.kaus…
@AlphaSignalAI The latest version of GPTCache, has added a `report` table, which means you can use it analyze cache hits.
You can cut your GPT API expenses by 50% through caching using LangChain and GPTCache. GPTCache uses embedding algorithms to convert queries into embeddings and uses a vector store for similarity search on these embeddings. This process allows GPTCache to identify and retrieve similar or related queries from the cache storage. You will also benefit from significant response time increase and API rate limit restrictions. pip install gptcache
Recently, I have received many inquiries about GPTCache and milvus from the community, such as Walmart! If you are also building an LLM-related product, I believe GPTCache and milvus can make it more attractive !!! @milvusio @zilliz_universe
A new report table has also been introduced, enabling users to analyze the access status of the cache more effectively!!!
In the latest version of GPTCache, an additional option for cache storage has been added, which is redis that also supports as the vector store. Along with this, ... github.com/zilliztech/GPT…
Thank you very much for your support of Milvus and GPTCache. If you encounter any problems while using GPTCache, please feel free to give us your feedback. We are also excited to hear about your experience with using GPTCache in your products. github.com/zilliztech/gpt…
Curious about how your @langchain app can scale to millions of users without missing a beat?🌍 Smart implementation of the cache is one of the key aspects! I have got another very simple, step-by-step mini-course to show you how @langchain can leverage GPTCache to -
What features do you anticipate adding in the next version? Feel free to submit an issue to me. Additionally, I would be delighted to hear about your experience using GPTCache.
Great news! A new version of GPTCache has just been released! This latest version includes new features such as the Qdrant vector store and the Mongodb cache store. And, some functions have been optimized based on feedback from the community. github.com/zilliztech/GPT…
@rohanpaul_ai @langchain Additionally, the community has contributed to expanding the types of supported stores, including Qdrant, MongoDB, and Redis. github.com/zilliztech/GPT…
@rohanpaul_ai @shanghaikid @langchain Thank you very much for your support. Currently, GPTCache has made significant efforts in improving the quality of cached answers through similarity evaluation using technologies such as Cohere Rerank API, SBERT Cross Encoder, etc.
Massive cost saving (by 50% or more 💵📷) of your ChatGPT API call by using caching with @langchain and GPTCache Integration. 🚀 Also much faster response times 📷 🚀 Overcoming the rate limits restrictions 🚀 Greatly enhance the scalability of your application, by reducing the load on the LLM service. 🚀 GPTCache first performs embedding operations on the input to obtain a vector and then conducts a vector approximation search in the cache storage. 🚀 After receiving the search results, it performs a similarity evaluation and returns when the set threshold is reached. You can adjust the threshold which will change the accuracy of its fuzzy search results. ⏰ If you enjoyed this post: 1. Follow me @rohanpaul_ai for more of this every day and 2. Like & Retweet this tweet: Also, check out my MachineLearning YouTube channel youtube.com/@RohanPaul-AI #opensource #LLM #vectorstore #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #langchain
There still appear to be usage scenarios for LLM cache.
一个大神逆向工程了 github copilot 的 vscode 插件,可以看到不是有个大模型再调试 prompt 就无敌了,还要配合很多工程才能在准确率、成本和用户体验上取得平衡。感觉未来针对大模型做代码开发会出专门的工程最佳实践, github.com/mengjian-githu…
Rosemary @potterrosemary9
171 Followers 3K Following
VC11 @Vuic1107
5 Followers 156 Following
Ishaan @ishaan_jaff
3K Followers 2K Following Co-Founder & CTO LiteLLM (YC W23) - Python SDK & LLM Gateway to Call 100+ LLMs in 1 format, set Budgets https://t.co/nXsBde05K7
barton.wasm @bmorphism
4K Followers 7K Following _ • 🪱🦆 discovery engine machinist 🔧 • {-1, 0, +1} • 🛸 #XM
gabrielF @gabriel05414927
1 Followers 43 Following
Golden Clover Educati... @GoldenCloverEdu
6 Followers 23 Following We provide online courses on ClickHouse
Sujay Rokade @sujay_rokade
7 Followers 225 Following
Andres Ramírez @andrexfy
20 Followers 98 Following The Digital Architect | Ingeniero Web Senior & Consultor Estratégico | +25 Años de Experiencia | Fusionando Ingeniería de Alto Rendimiento (Nuxt/Vue) con Diseño
云中江树-LangGPT @LangGPT
308 Followers 354 Following LangGPT: https://t.co/AriDzjLhI1 Discord: https://t.co/QB0UJmnSza 知识库: https://t.co/AckTAp47yi #chatgpt #gpt4 #prompt #agi #gpt #ai
Siddha @0xSiddha
3 Followers 160 Following
Randwick @Jerrybit
107 Followers 1K Following
代码家 @daimajia
15K Followers 4K Following 🎸独立投资人/ 👨💼 前真格基金投资 VP / 🚀 峰瑞资本投资经理 / 🛠️ 掘金联合创始人 / 🌊 GitHub 4w 星达成者 / 🎓 北京师范大学计算机硕士 / 🎓 西安西北大学学士 / 一个戴着大人面具🎭的小朋友👶
nobody @phiweger
364 Followers 1K Following Counterfactual persona. Genomics for microbes. LLMs for teaching. Occasionally I support my views.
yoshi-taka 🦋 ask-y... @ask_yoshi_taka
375 Followers 2K Following prev. Led M&A AWS integration, security PMI, FinOps (RI/PPA negotiations, cost reductions), and enterprise customer enablement for large-scale teams.
TheSamurai @the_wisetrader
272 Followers 3K Following All trades must have stop loss. Do not fade the market. Do not add onto losers. Add onto winners. Ride the trend -- don’t guess the end. Learn to let go.
alexanderadam @alexanderadam__
524 Followers 1K Following Software dev working in @rubylangorg & @CrystalLanguage as a #freelancer & at @vade_io. Tweets may be in English or German. https://t.co/kbhMA04jiz
lurking @ilelurking
32 Followers 4K Following
JoanFM @JoanFM_
166 Followers 773 Following Open Source @JinaAI_ and @docarray | https://t.co/KWMccEUeJj
Ash Vardanian @ashvardanian
3K Followers 460 Following Building @unum_cloud since 2015 · Investing @aal_vc · author of USearch, StringZilla, NumKong - some of the world's most widely used open-source infra
Sunpreet Singh @20Sunpreet
577 Followers 3K Following Dartmouth alum from Queens NY. Currently investing in SaaS (focused on AI, ML, dev tools, data infra) at Insight Partners.
jiaoew @EnweiJiao
107 Followers 354 Following data infra @LumalabsAI / maintainer of @milvusio & @lance-format/ ex @MiniMax_AI @zilliz_universe/
MoEla @ShifraTech
44 Followers 781 Following Software Engineering & Security Research (Red Teaming) 🔜🔜 Youtuber soon... building @TalibAI_inc I mostly retweet to share with my future self and others 💖
du su @dusu1669444
0 Followers 262 Following
Fendy Feng @Fendy_like
44 Followers 218 Following PMM @Zilliz_universe. | Loving @milvusio, the world's most popular open-source vector database. | Opinions are my own.
James Luan @James183995
4 Followers 6 Following
Allen Z @allen_zz0
4 Followers 977 Following
AdaQI @adarinerrr
13 Followers 686 Following
Yangyang Feng @fengyangyang98
42 Followers 137 Following 🧑🏻💻 PhD candidate @ Tsinghua Univ. 🤖️ Sys for LLM 🏋️🏃🏊
扣子Coze @CozeHQ
4K Followers 55 Following Coze,an AI for For workplace Discord: https://t.co/37EX8jMHVK Telegram: https://t.co/jkh53f8uZL Youtube: https://t.co/Ewy94TcyWt
Manus @ManusAI
249K Followers 29 Following Manus from @Meta is the general AI agent that bridges minds and actions: it doesn't just think, it delivers results. Telegram: https://t.co/kdHdNxZ6xF
Commentary Donald J. ... @TrumpDailyPosts
3.0M Followers 24K Following Reposting Trump’s Truth Social posts (with date/time) on X + news/commentary. Unofficial. Profile Artist: @ElenaRuseva1 Not affiliated with @realdonaldtrump.
OpenAI @OpenAI
4.9M Followers 4 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA
DeepSeek @deepseek_ai
1.0M Followers 0 Following Unravel the mystery of AGI with curiosity. Answer the essential question with long-termism.
President Trump 45 Ar... @POTUS45
30.0M Followers 38 Following This is an archive of a Trump Administration account, maintained by the National Archives and Records Administration.
Donald J. Trump @realDonaldTrump
111.6M Followers 53 Following 45th & 47th President of the United States of America🇺🇸
Alex Graveley @alexgraveley
46K Followers 2K Following Co-creator Perplexity Computer, GitHub Copilot, Dropbox Paper. 2x CEO. Thruhiker. Survivor 🎗️
Shivansh Kaushik @shivansh_k_
50 Followers 63 Following AI agents · Data infra · Full-stack LLM delivery I help teams move from raw data to real, deployable AI products. Founder @Primastat
Lior Alexander @LiorOnAI
116K Followers 2K Following Founder @AlphaSignalAI → the Intelligence layer of AI (300k users) • MIT Lecturer • ex-MILA researcher • In ML since GANs
Ash Vardanian @ashvardanian
3K Followers 460 Following Building @unum_cloud since 2015 · Investing @aal_vc · author of USearch, StringZilla, NumKong - some of the world's most widely used open-source infra
Anthropic @AnthropicAI
1.4M Followers 2 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
Fendy Feng @Fendy_like
44 Followers 218 Following PMM @Zilliz_universe. | Loving @milvusio, the world's most popular open-source vector database. | Opinions are my own.
jiaoew @EnweiJiao
107 Followers 354 Following data infra @LumalabsAI / maintainer of @milvusio & @lance-format/ ex @MiniMax_AI @zilliz_universe/
James Luan @James183995
4 Followers 6 Following
Python Trending 🇺�... @pythontrending
52K Followers 2 Following trending Python repositories on GitHub (https://t.co/dKFSrAQ52h)
shanghaikid @shanghaikid
244 Followers 2K Following
云中江树-LangGPT @LangGPT
308 Followers 354 Following LangGPT: https://t.co/AriDzjLhI1 Discord: https://t.co/QB0UJmnSza 知识库: https://t.co/AckTAp47yi #chatgpt #gpt4 #prompt #agi #gpt #ai
🍋 Hazymoon @Ice_Hazymoon
6K Followers 3K Following 现居东京 / ADHDer / INTP / 全干工程师 / 梦想是世界和平 / 不建政,日常碎碎念和看色图
Jerry Liu @jerryjliu0
77K Followers 1K Following Parsing the world's hardest PDFs @llama_index. cofounder/CEO Careers: https://t.co/EUnMNmbCtx Enterprise: https://t.co/Ht5jwxSrQB
Masa 2025.2~ YMS🇬�... @masa_engineer05
33 Followers 137 Following 日系ソフトウェアエンジニア→外資→25/2〜イギリス🇬🇧 #yms #ワーホリ #イギリス
Marcus D. R. Klarqvis... @MarcusKlarqvist
1K Followers 803 Following ✦ CTO of Cambridge Heartwear ✦ Building medical devices ✦ PhD UCambridge + Harvard + MIT
gakaki @gakaki
17 Followers 225 Following
vivek raju muppalla @vim1up
211 Followers 308 Following Sushi and Ramen Lover. Mostly retweets; opinions are my own, not those of my employer.
远山 @cloud728838
106 Followers 1K Following
Semantic Press @SemanticPress
98 Followers 120 Following A semantic compiler that turns unstructured company knowledge into executable company brain 🧠
Zilliz @zilliz_universe
2K Followers 4K Following Building vector database for enterprise-grade AI. Company behind @milvusio. 🧑🚀Join our team: https://t.co/oZA7g1XgZ2🚀 🔗Find us: https://t.co/Xynh3Xx30X
Emily Kurze @EmilyinTech
249 Followers 227 Following Open source tech enthusiast. Tweets are my own.
Chris Churilo @Chris_Churilo
358 Followers 1K Following loves art, design, music, puppy dogs and SUP- oh and cool projects using vector databases like Retrieval Augmented Generation, & Product recommenders.
Milvus @milvusio
5K Followers 5K Following The most widely adopted open source vector database for #AI #OpenSource #VectorSearch 💬Discord: https://t.co/PHnys5NWdR 🔗Find us: https://t.co/BbTzkz9bHN































