Data contamination is a huge problem for LLM evals right now. At Scale, we created a new test set for GSM8k *from scratch* to measure overfitting and found evidence that some models (most notably Mistral and Phi) do substantially worse on this new test set compared to GSM8k.
Multi-Stage Advanced RAG with @llama_index and @cohere reranking
Making retrieval a multi-hop process 💡 instead of single-shot can ensure better LLM context and reduce hallucinations.
This article by Michael R. (@kxsystems) highlights an example of this multi-stage…
3K Followers 1K FollowingLLM = Live + Love + Make 🌈 DevRel @Cohere
I write and make videos about things I'm trying to grasp.
The latest baby is my podcast. She/her. Views are mine!
13K Followers 1K FollowingML Engineer (e/acc)
📌 https://t.co/x0IIWfnOt8
🚀 https://t.co/QEO4CKRl1b
Open LLMs is Happiness 💡
Ex Deutsche & HSBC.
DM for collaboration.
4K Followers 900 FollowingComet provides a meta machine learning platform that enables data scientists & teams to track, compare, explain, & optimize their experiment tracking.
820 Followers 128 FollowingVectorize makes it easy to turn your unstructured data into always-up-to-date vector data to power your generative AI applications.
105 Followers 2K FollowingPart Time Writer & Traveller,
Full time overthinker.
Respect people and value emotions,
IIT(ISM) DHANBAD,
Lead (Analytics), MBA(Business Analytics)
59 Followers 120 FollowingAI (ML I DL | NLP | GENAI | RL)
Interested in applying AI in wider range of Application and Reverse Engineering Neural Networks. 🤖
900 Followers 4K FollowingMachine Learning Engineer whose life revolves around Music, Books and Technology. Co-founder of @tinkerhub, a non-profit educational initiative.
2K Followers 1K FollowingDevrel and Making AI better @union_ai | Helped thousands start with ML & computer vision | I do #AI + #MLOps + #Robotics | ❤️🤖
1K Followers 223 FollowingDirector of Safety and Standards at Scale AI. Prev: RLHF lead on Bard, researcher at Google DeepMind / Brain (LaMDA, RL/TF-Agents, superhuman chip design)
38K Followers 769 FollowingOfficial account for the 33rd Mayor of the City of Miami, @FrancisSuarez. The first Miami-born mayor is focused on making the Magic City a global city.
4K Followers 70 FollowingOur mission is to make @CityofMiami the "capital of capital" with an innovative technology ecosystem and economy that delivers for everyone.
5K Followers 1K FollowingCS PhD candidate @PrincetonCITP. I study the societal impact of AI. Currently writing a book on AI Snake Oil: https://t.co/tb2lXSP2gB
119K Followers 413 FollowingPrinceton CS prof. Director @PrincetonCITP. I write about the societal impact of AI, tech ethics, & social media platforms.
BOOK: AI Snake Oil. Views mine.
3K Followers 1K FollowingLLM = Live + Love + Make 🌈 DevRel @Cohere
I write and make videos about things I'm trying to grasp.
The latest baby is my podcast. She/her. Views are mine!
29K Followers 1 FollowingFastAPI framework, high performance, easy to learn, fast to code, ready for production. 🚀
Web APIs with Python type hints. 🐍
By @tiangolo 🤓
13K Followers 1K FollowingML Engineer (e/acc)
📌 https://t.co/x0IIWfnOt8
🚀 https://t.co/QEO4CKRl1b
Open LLMs is Happiness 💡
Ex Deutsche & HSBC.
DM for collaboration.
5K Followers 1K FollowingDEF inspires, connects and empowers people committed to US national security in order to promote and enable a culture of innovation. https://t.co/bi5F26y1Sw
338K Followers 61 FollowingThe world’s work marketplace, connecting millions of businesses with independent talent. For customer support visit: https://t.co/6GvJOhglpE
2K Followers 319 FollowingAI Product Director @Meta (again) leading Generative AI open source ex-Google, ex @PyTorch leader ex-Amazon - Love building community around AI and Open Source.
3K Followers 250 FollowingProfessional AI Engineer.
Sharing what I'm currently learning, mostly about AI, LLMs, RAG, building AI powered software, AI automation etc.
5K Followers 92 FollowingResearch Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.
4K Followers 900 FollowingComet provides a meta machine learning platform that enables data scientists & teams to track, compare, explain, & optimize their experiment tracking.