We’re hosting an in-person AI Agents meetup next week in Menlo Park, CA with @p0 and @Snowflake.✨
If you’re interested in joining, you can register here:
luma.com/z2qae6kx
See you there next week!
The upcoming @deepchecks webinar is about "End-2-End Evaluation of RAG-Based Applications".🚀
We will cover the best practices for evaluating RAG apps, covering initial experiments, version comparison, and ongoing evaluation. ✅
Register here: linkedin.com/events/end-2-e…#LLMs
The upcoming Deepchecks webinar is about "LLM Application Observability".✨
In this session, Jessica Kerr from @honeycombio and Yaron Zakai-Or from @deepchecks will guide you through LLM Evaluation & Judge Models. 🚀
Register here: linkedin.com/events/llmappl…#LLMs#AI#ML#MLOps
Last week, we released the @Deepchecks LLM Evaluation solution publically on LLMOps Space and Product Hunt! Since then, 𝐰𝐞 𝐡𝐚𝐯𝐞 𝐫𝐞𝐜𝐞𝐢𝐯𝐞𝐝 𝐝𝐨𝐳𝐞𝐧𝐬 𝐨𝐟 𝐫𝐞𝐪𝐮𝐞𝐬𝐭𝐬 𝐟𝐨𝐫 𝐠𝐞𝐭𝐭𝐢𝐧𝐠 𝐚𝐜𝐜𝐞𝐬𝐬 𝐭𝐨 𝐨𝐮𝐫 𝐋𝐋𝐌 𝐞𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧 𝐩𝐥𝐚𝐭𝐟𝐨𝐫𝐦. 🚀
In the launch webinar, 150+ people tuned in and we had a super successful launch. 🥳
🏄♂️ You can request the Deepchecks LLM evaluation platform here: deepchecks.com/solutions/llm-…
🎥 In case you missed the webinar, here's the link to the session recording: youtu.be/zSooEIrMf-c?fe…
(And our next LLMOps Space event is with the Pinecone ~ happening in just 9 days!, 🚀 register here: linkedin.com/events/7137528…)
Also, if you'd like to launch your LLM-related projects with LLMOps Space, feel free to send me a DM. We'd be happy to help you with your launch, 𝐟𝐨𝐫 𝐟𝐫𝐞𝐞! ❤️
🚀 I’m thrilled to share some exciting news: 𝐃𝐞𝐞𝐩𝐜𝐡𝐞𝐜𝐤𝐬' 𝐧𝐞𝐰 𝐋𝐋𝐌 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧 𝐦𝐨𝐝𝐮𝐥𝐞 𝐢𝐬 𝐧𝐨𝐰 𝐥𝐢𝐯𝐞! ✨
😊Show your support on ProductHunt:
producthunt.com/posts/deepchec…
Since our open-source package launch in January 2022 for testing ML models, the response from the community has been incredible, with over 3,000 GitHub stars and more than 900,000 downloads. 📈
Today, we're proud to announce the launch of our LLM Evaluation module, designed to tackle the unique challenges posed by LLMs. 🧠💬
What makes this LLM Evaluation module special:
✅ 𝐃𝐮𝐚𝐥 𝐅𝐨𝐜𝐮𝐬: Assess both accuracy and model safety (bias, toxicity, PII leakage).
📝 𝐅𝐥𝐞𝐱𝐢𝐛𝐥𝐞 𝐓𝐞𝐬𝐭𝐢𝐧𝐠: Adapt to scenarios where multiple valid responses are possible.
👥 𝐃𝐢𝐯𝐞𝐫𝐬𝐞 𝐔𝐬𝐞𝐫 𝐁𝐚𝐬𝐞: Empower data curators, product managers, and business analysts as well as the SWEs and ML practitioners.
🚀 𝐌𝐮𝐥𝐭𝐢-𝐏𝐡𝐚𝐬𝐞 𝐀𝐩𝐩𝐫𝐨𝐚𝐜𝐡: Cover Experimentation, Staging, and Production phases.
We believe this module will make a dent in how AI systems are validated, especially in the dynamic world of LLM-based applications. 🌐
#LLMs#opensource#ArtificialInteligence#ML#GPT4
The most recent LLMOps.Space webinar featured @yujian_tang from @zilliz_universe, where he talked about "Advanced RAG concepts: Chunking, Embeddings, and Vector Databases". 🙌
It was one of the most engaging sessions we hosted at LLMOps Space, 150+ 𝐋𝐋𝐌 𝐩𝐫𝐚𝐜𝐭𝐢𝐭𝐢𝐨𝐧𝐞𝐫𝐬 𝐚𝐫𝐨𝐮𝐧𝐝 𝐭𝐡𝐞 𝐰𝐨𝐫𝐥𝐝 𝐭𝐮𝐧𝐞𝐝 𝐢𝐧, and lots of interesting questions were being asked (the most asked question was about chunking 😮 ).
😊 In case you missed the event or want to revisit it, we got you, here's the link to the recording: youtu.be/tTW3dOfyCpE?fe…
----------------------------------------------------------
The next LLMOps Space event is with Itamar Golan, cofounder of Prompt Security ~ 𝐡𝐚𝐩𝐩𝐞𝐧𝐢𝐧𝐠 𝐧𝐞𝐱𝐭 𝐰𝐞𝐞𝐤!, 🚀 register here: linkedin.com/events/7124727…
𝐉𝐨𝐢𝐧 𝐭𝐡𝐞 𝐝𝐢𝐬𝐜𝐨𝐫𝐝 👉 llmops.space/discord#llmops#mlops#machinelearning#openai#generatieveai#largelanguagemodels#ai#opensource
.@Deepchecks CTO @ShirChorev explores the common pitfalls of ML models and best practices for testing them.
By the end of the video, you'll be ready to integrate ML model testing into your workflow, ensuring your models are reliable and maintainable
youtube.com/watch?v=jvRXPk…
Missed out on the sneak peek at @deepchecks#computervision submodule?
(No, it hasn't been released yet =] )
The recording + summary of our community call from last month are live on our website:deepchecks.com/event/feb-2022…
Deepchecks was selected as one of the best data-centric MLOps tools in 2022.
Thanks @activeloop for the recognition! Much appreciated
activeloop.ai/resources/5124…
"900 Stars in 2 Weeks: Deepchecks’ Open-Source Release and Everything Leading Up To It"
Check out this latest piece by our CEO @PhilipTannor describing the "behind the scenes" of our open-source release:
medium.com/@ptannor/900-s…
A bit less than a month since its release, Deepchecks' #Python library has just reached 𝟭𝟬𝟬𝟬 𝘀𝘁𝗮𝗿𝘀 𝗼𝗻 #github
The 1000th star was given by Hamza Tahir from ZenML. Thanks, Hamza!
If you’re involved in an open-source project or tech entrepreneurship (or considering becoming involved), this piece is for you. Deepchecks’ CEO @PhilipTannor with a detailed overview of the “behind the scenes” of our recent launch.
𝐎𝐮𝐫 𝐨𝐩𝐞𝐧 𝐬𝐨𝐮𝐫𝐜𝐞 𝐌𝐋 𝐕𝐚𝐥𝐢𝐝𝐚𝐭𝐢𝐨𝐧 𝐩𝐚𝐜𝐤𝐚𝐠𝐞 𝐠𝐨𝐭 𝐢𝐭𝐬 𝐟𝐢𝐫𝐬𝐭 𝐫𝐞𝐯𝐢𝐞𝐰𝐬
🐍 Releasing #deepchecks to #opensource really felt like opening a restaurant + waiting for the morning's paper =]
One review by @jeremydiba:
bit.ly/33rIDTq
Check out our latest blog post by Philip Tannor, explaining the different types of data drift. From the post:
"(Real) concept drift is the situation when the functional relationship between the model inputs and outputs changes."
deepchecks.com/data-drift-vs-…
Ever wondered what should you look out for and monitor when you deploy your new ML model to production? Read our latest blog post by @ItayGabbay to review the ML model monitoring checklist every ML model needs!
deepchecks.com/ml-model-monit…
Supervised and Unsupervised learning differ not only by the problems they aim to solve, but by the engineering problems they pose to Data Scientists and Engineers. Read our latest blog post by @BresslerNoam to learn more!
deepchecks.com/supervised-vs-…
32 Followers 158 FollowingSoftware Engineer, Automation, Jira/Confluence, Filmophile, Foodie.
Life begins at the end of your comfort zone and Never be afraid to try something new.
4 Followers 64 Followinghttps://t.co/tlkwlo4Wv0
Convert your N8N workflow into a saas product in minutes
You build the N8N workflow. We handle user registration, access and payments.
532 Followers 2K FollowingCybersecurity, Prompt SecOps, Agentic Engineering, Tesla, Paella, and Fútbol - Use my Tesla referral code link https://t.co/FKuM7vd3ke
304 Followers 3K FollowingDiscover the power of AI, explore its potential & join the conversation about its future. #BeyondTheAi #AI @BeyondTheAi @BeyondTheAiNews for dedicated Ai News
716 Followers 2K FollowingDigital Xformist, CMO at @CloudFabrix | AI | SaaS | Early stage startups | classical Tabla |Astanga Yoga |Ayurveda practitioner | Tweets are mine only
2 Followers 824 FollowingCrystal Museum Garden CMG. Chief Administrator and technical writing engineer. ♠️ 💜 Stay Pretty Yoga TIME🌳🌈 C6 🗝️ Wife of Killer Tesla Victory and Mr. Big
6K Followers 5K FollowingCEO at Deepchecks | Moderator at https://t.co/eIctpd8n3A | Forbes 30 Under 30 | Open Source Validation of AI & LLMs
https://t.co/e8ivMRLuEp
171K Followers 28K FollowingML & AI Engineering • LLMs • MLOps • Data Engineering • Practical AI systems, architectures, tools and curated resources for AI.
250K Followers 2K FollowingThe world's leading publication for data science and artificial intelligence professionals.
Submit an Article ✍️ https://t.co/57pIMegK1o