Yatharth kapadia @yatharthk2
Masters Student at IUB Chicago, IL Joined June 2018-
Tweets264
-
Followers71
-
Following449
-
Likes1K
If we view Attention and MLP as below, they look drastically similar: Attention: out = f(Q * K^T) * V MLP: out = g(X * W_1) * W_2 where f is Softmax and g is whatever nonlinearity. So, why is there a FlashAttention but no FlashMLP? 🤔 As a CUDA enthusiast, I have a theory,…
Towards Large Language Models as Copilots for Theorem Proving in Lean - Opensource all codes under MIT license - Shows effectiveness in assisting humans and ATP process compared to existing rule-based proof automation repo: github.com/lean-dojo/Lean… abs: arxiv.org/abs/2404.12534
Who is creating a pytest-like tool for testing LLMs (where you can also track metrics, version data alongside code, etc)? looking for OSS
All of @RLanceMartin's expertise on RAG combined into a 2hr30min long video!
All of @RLanceMartin's expertise on RAG combined into a 2hr30min long video!
What a week, huh? 1. Mojo 🔥 went open-source 2. Claude 3 beats GPT-4 3. $100B supercomputer from MSFT and OpenAI 4. Andrew Ng and Harrison Chase discussed AI Agents 5. Karpathy talked about the future of AI ... And more. Here is everything that will keep you up at night:
5 insane websites that feel illegal to know about:
Solution #2: Integrate best-of-breed MLOps tools (aka Serverless ML) You choose best-of-breed single-purpose tools, for example: → Hopsworks as Feature Store 📊 → Weights&Biases as Experiment tracker 🧪 → Modal as Compute Engine 🏋️♂️ → HuggingFace for Model serving 💁
I guess this "Sora" paper could easily be cited thousands of times in a few years. similar to this "ReLU" paper...
I guess this "Sora" paper could easily be cited thousands of times in a few years. similar to this "ReLU" paper... https://t.co/JcJ0GeV8ZF
how to live forever
This is why football is a beautiful sport
Happy World Elephant Day 🐘 Sharing again this incredible incident when TN Foresters rescued & united a baby elephant with the herd in Mudumalai in Oct 2021.The way the kutty elephant faithfully walks behind the foresters melts the heart ❤️ #worldelephantsday
Always running behind an endless search for satisfaction........ but one question still remains .... was it worth it ??
According to Hive Systems your passwords should be at least 18 mixed up characters for maximum security. Here's how long it would take a hacker to come up with as many combinations or passphrases before guessing your password [read more, methodology: buff.ly/3DywidQ]
Don’t lie and say April fool. Plant a tree and say April Cool.
Putin fauj mei, Market mauj mei
Yoshie Carnegie @YosCarneg
75 Followers 5K Following
Mckinley West @MckinleyW20455
130 Followers 3K Following
DoloresEdie @S7bgw60jeA9k7
87 Followers 2K Following
Titethough @titethough27224
1 Followers 163 Following
DaleMaurice @lWvELGFuG5LFN3z
0 Followers 18 Following
Sarfesloughs @Sarfesloughsoc
0 Followers 35 Following
Janice @germain77janice
130 Followers 3K Following
Petra Llanet @LlanePet
40 Followers 5K Following
Daniel Flynn @DanielFlyn91382
16 Followers 729 Following
Senyse @Senyse352859
0 Followers 151 Following
Rumaisa Bainard @ruma_bain
70 Followers 5K Following
Florence @florence_elias_
154 Followers 3K Following
Ivy Thackeray @thackeray_30799
91 Followers 5K Following
Lorena Niceswander @LNiceswand11938
61 Followers 5K Following
Abby Mastine @abb_mast
80 Followers 5K Following
ณรณี @901861M00b3WKq
73 Followers 0 Following คุณต้องการนัดเดทกับสาวไหมคะ เพิ่ม https://t.co/aoujxSco8t
Grady Wade @GradyWade41669
8 Followers 678 Following
Edwin Walker @EdwinWalke31761
148 Followers 3K Following
Jennifer Montano @JenniferMo68927
96 Followers 3K Following
Angel Anderson @AngelAnder70951
117 Followers 3K Following
Audrey Whitney @whitney_au96237
88 Followers 3K Following
วิไลวาส.. @Ov2ksnRva6P8m9T
69 Followers 1K Following ตามฉันมาและปล่อยให้เดทของคุณเต็มไปด้วยความประหลาดใจและความหวาน! หน้าแรกจะมีข้อมูลการติดต่อของฉันเป็นครั้งคราว
Lillian @borysewiczlilli
178 Followers 3K Following
Meadow Jankowski @JankowskiM51411
67 Followers 5K Following
Ka Aguillon @aguillo_ka
44 Followers 5K Following
Caitlin Gauthier @CaitlinGauthi19
669 Followers 1K Following
Sian Jose @SianJose2
2K Followers 3K Following
Juliet Bicknell @BicknellJuliet
1K Followers 2K Following
Jose Crossman @CrossmanJoseee
6 Followers 40 Following Experienced marketing strategist with a data-driven approach. Skilled in developing comprehensive campaigns that resonate with target demographics.
Fadi 🦅 @fadieacc
1K Followers 2K Following 1 exit • Leveling up indefinitely • on a life mission to build/acquire a portfolio of +100 profitable companies • Sharing learnings. 3/100 ⌛
Savannah-rose Dershem @SavannahD94927
59 Followers 5K Following
Ruby-rose Searby @RubySearby43907
80 Followers 5K Following
Alice @ErinWillia83801
1 Followers 887 Following
Nadia Babeu @babeu18313
47 Followers 5K Following
Rhiannon Lamy @LamyRhiann46790
85 Followers 5K Following
Helen Presser @presser18683
70 Followers 5K Following
Clementine Randall @Clementine26456
75 Followers 5K Following
Corrine Kipp @rhythmicsportsm
10 Followers 46 Following Live life with no regrets. #FLR #BlockchainNews
Nakul Havaldar @nakul_havaldar
3 Followers 43 Following
Nupur @NupyaaNupur
0 Followers 14 Following
Krish Garg @kisu_pvt
5 Followers 10 Following
ayush @space_ayush
44 Followers 130 Following Aam Aadmi in love with the rhythms of folk music and Indian classical compositions.📜🎵
Rutvik Tak 💙 @TakRutvik
2K Followers 659 Following Building @getpieces | Maker @AppShotss | 💫 Creative coding https://t.co/oKXviRD8mH | 📘 Flutter blog https://t.co/WHrz3Hjtic 💬 Talks about Flutter+Dart and indie building 💪
Vrishani Shah @VrishaniShah
11 Followers 59 Following Blockchain enthusiast...Fintech Learning the tricks of the trade
Siddharth Sarma @Sid_Sarma5
58 Followers 351 Following Computer Science Undergrad. Arsenal Supporter. Trust the process.
Tikka @tikka2001
17 Followers 28 Following
Supabase @supabase
109K Followers 75 Following Open Source Firebase alternative. 🌐 https://t.co/kHsst88pKt ⭐️ https://t.co/txGagqnMbK 🎥 https://t.co/6eTjCTHTKc 💬 https://t.co/ikFm89oi6a
Cory House @housecor
117K Followers 714 Following Consultant. Sharing coding tips. I help devs grow. Teaching software dev: https://t.co/D5emROQa4J Helping teams switch to React: https://t.co/Qfp4Tfp3jf ⚛️
Matt Pocock @mattpocockuk
142K Followers 581 Following Full-time TypeScript educator. Ex-@vercel, @statelyai. Used to be a voice coach. He/him. Author of Total TypeScript 🧙 Hire me to teach your team TypeScript!
Lee Robinson @leeerob
126K Followers 706 Following VP of Product @Vercel. Helping developers build a faster web. Teaching about React and Next.js.
Theo - t3.gg @t3dotgg
137K Followers 2K Following I make videos, dev tools, companies, and investments. Founder of @pingdotgg (YC W22)
Adam Wathan @adamwathan
211K Followers 737 Following Creator of @tailwindcss. Listener of Slayer. Austin 3:16.
Jarred Sumner @jarredsumner
96K Followers 786 Following building @bunjavascript. formerly: @stripe (twice) @thielfellowship. high school dropout. npm i -g bun
Kent C. Dodds 🌌 @kentcdodds
259K Followers 256 Following Improving the world with quality software · Husband, Father, Latter-day Saint, Teacher · https://t.co/pPQmnZS6rR, https://t.co/NYn5aJVGve, https://t.co/U5KafpJTZp
Steve (Builder.io) @Steve8708
87K Followers 685 Following CEO @builderio - design to production, faster
Josh W. Comeau @JoshWComeau
127K Followers 2K Following Indie hacker and educator. Blogging at https://t.co/kbdJDUdLg5. Previously @gatsbyjs, @digitalocean, @concordia_btcmp, @khanacademy. He/Him 🌈
William Wolf @willium
3K Followers 2K Following Now: Founder of @GestaltHDI / Then: Founder of Bayes (acq. Airtable)
Philipp Schmid @_philschmid
16K Followers 651 Following Tech Lead and LLMs at @huggingface 👨🏻💻 🤗 AWS ML Hero 🦸🏻 | Cloud & ML enthusiast | 📍Nuremberg | 🇩🇪 https://t.co/l1ppq3q3hk
Pedro Cuenca @pcuenq
5K Followers 768 Following ML Engineer at 🤗 Hugging Face | Co-founder at LateNiteSoft (Camera+). I love AI and photography.
Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.
Sian Jose @SianJose2
2K Followers 3K Following
Sohaib @sohaibneuphonic
18 Followers 33 Following Co-founder & CEO @neuphonicspeech. Previously a HF Quant. AI/ML @cambridge_eng. Exploring hyperrealism in conversational ai
Devendra Chaplot @dchaplot
8K Followers 365 Following Building next-gen AI at @MistralAI. Past: Research Scientist at Facebook AI Research. Ph.D. @SCSatCMU, BTech @iitbombay CS.
Phil Morettini @TechnologyGuy
16K Followers 11K Following IT Industry C-Level Interim Exec, Consultant & Blogger to SaaS, Software & Hardware Companies. Loves the Illini, Cubs & Bears: https://t.co/uDUzDbg5Yn
Igor Marinelli @MarinelliIgor
1 Followers 0 Following
James 🤌🏻 @jamesm
74K Followers 1K Following Design @clerkdev. I run a tiny design studio @wireframe. Download icons @theiconicapp. Prev: @tailwindlabs
rauno @raunofreiberg
55K Followers 336 Following
Ankur Nagpal (hiring .. @ankurnagpal
86K Followers 996 Following Founder of @carryhq_. Founded @teachable (sold to @hotmart). Investor in 100+ companies @thevibecap. On a mission to help people be better with money.
Tome @magicaltome
26K Followers 761 Following The leading AI-native research and presentation platform for sales and marketing teams.
Alex Cornell @alexcornell
23K Followers 682 Following Interface designer at Meta (Gen AI). Prev: Linear / Substack / Cocoon / Facebook / Dialpad / ISO50
Michael Houck 💡 @callmehouck
55K Followers 954 Following Follow me to learn how to build and grow startups. 80,000 founders read my free weekly newsletter.
Zach Coelius @zachcoelius
27K Followers 3K Following Hopelessly addicted entrepreneur. Currently investing in other great entrepreneurs. My User Manual: https://t.co/Yv6Qp1hyy2 Rolling Fund: https://t.co/xTWKHJJODL
Σ AnotherSigma | �.. @anothersigma0x
33K Followers 1K Following Artist | Always learning and executing | https://t.co/FbfHXjYyeV
Ben Jammin 🍌 @xBenJamminx
80K Followers 7K Following 💻 Exploring Web3, Gaming, AI, Parenting, Cooking & Anything that excites me
Eth.co @ethdotco
23K Followers 4K Following Add .co to ANY .eth name to see their NFTs and profile instantly! Check out our page at https://t.co/8anxYb2yRJ ❤️
Jack Altman @jaltma
76K Followers 415 Following Investing at Alt Capital. Founder and chairman of Lattice.
Hoizon.ᴱᵀᴴ @HoizonArt
53K Followers 7K Following Painter • Collector • ▪️curated @NEURONEXUSwo ▪️ https://t.co/b5fP9Lm1kO
Together AI @togethercompute
27K Followers 304 Following The future of AI is open-source. Let's build together.
Cozomo de’ Medici @CozomoMedici
300K Followers 2K Following Grand patron of the digital arts 🌹 Art: @kdean ⚔️ Business: @gbmedici ⚜️🔴🔴⚜️🔴⚜️🔴🔴 ⚜️
Vipul Ved Prakash @vipulved
5K Followers 841 Following Building an AI supercomputer out of spare internet parts. Founder, CEO @togethercompute
scott belsky @scottbelsky
130K Followers 2K Following helping the creative world make ideas happen. founder @behance, strategy/product/design @adobe, author, angel in startups the world needs. product obsessive.
Andrew Gazdecki @agazdecki
233K Followers 6K Following Founder and CEO of @acquiredotcom. https://t.co/wRMIssDmhl has helped 100s of startups get acquired and facilitated $500m+ in closed deals.
Patrick McKenzie @patio11
164K Followers 796 Following I work for the Internet and am an advisor to @stripe. These are my personal opinions unless otherwise noted.
Gergely Orosz @GergelyOrosz
249K Followers 2K Following Writing @Pragmatic_Eng, the #1 technology newsletter on Substack. Author of @EngGuidebook. Formerly Uber & Skype.
Synthesia 🎥 @synthesiaIO
21K Followers 89 Following Create AI videos from text in minutes. Trusted by 50.000 companies like Amazon, Accenture, Reuters.. We're always hiring: https://t.co/XIuqBMrMiZ
Daniel Vassallo @dvassallo
173K Followers 2K Following https://t.co/X5QMm3wlHe (use code FOLLOWER at checkout to join at half price)
💾 LLM Datasets LLM development is increasingly moving towards curating high-quality datasets, as shown by Llama 3. I've compiled a collection of fine-tuning datasets along with advice and tools for creating your own. 💻 GitHub: github.com/mlabonne/llm-d…
Mixtral 8x7b going 378 tokens per second on CPU.
The Top ML Papers of the Week (April 22 - April 28): - Phi-3 - OpenELM - AutoCrawler - Self-Evolution of LLMs - AI-powered Gene Editors - Make Your LLM Fully Utilize the Context ...
Great release from @cohere. Many interesting details in this codebase. See for instance all the markdown plugins to display LLM generated content. github.com/cohere-ai/cohe…
Favorite release in April: we open-sourced Coral, our RAG-optimized chat interface! What's inside? 🪸 > multi-turn conversations, citations, document uploads, chat history > supports custom retrieval tools and data sources > integrates with our models on AWS and Azure, soon all…
I'm keen to learn more about MLX Machine learning library over the weekend and there has been a lot of great content about it. I have started an awesome-mlx repo to collect all resources. Please help to spread the words and contribute if possible 🙏 github.com/antranapp/awes…
"We show in our paper that the behavior of LLMs is consistent with Bayesian learning and explain many empirical observations of the LLMs using our model." Very interesting paper mapping LLM behavior to Bayesian learning: arxiv.org/pdf/2402.03175
If anybody is at ASPLOS, I'll be at the PyTorch tutorial! I'll be presenting a tutorial on TorchInductor and also some random speculation on research ideas. github.com/pytorch/worksh…
🧠 Run LLama 3 70B on a Single 4GB GPU - with airllm and layered inference 🔥 layer-wise inference is essentially the "divide and conquer" approach 📌 And this is without using quantization, distillation, pruning or other model compression techniques 📌 The reason large…
What is the most impactful ML systems work from academia published at a systems conference? For example, ASPLOS or OSDI?
Today I’m excited to share a little about the new company I’ve been working on: Gestalt is the best way for businesses to deeply understand people. In many ways, I view Gestalt as a Human Data Interface — a new kind of tool that reimagines how we think about data as humans,…
RESEARCH OPPORTUNITY ALERT. If you're interested in synthetic data, we're recruiting for a Research Scholar to collaborate with Cohere For AI for a 6-month internship. Must be available full-time starting ASAP. DM if you're interested 🥰.
I've just released llamafile v0.8 which features LLaMA3, Mixtral 8x22b, and Grok support. It goes 25x faster than ollama at running LLaMA3 70B on CPU. My new tensor multiplication kernels let llamafile eval MoE models 2x faster than llama.cpp github.com/Mozilla-Ocho/l…
Snowflake dropped a 408B Dense + Hybrid MoE 🔥 > 17B active parameters > 128 experts > trained on 3.5T tokens > uses top-2 gating > fully apache 2.0 licensed (along with data recipe too) > excels at tasks like SQL generation, coding, instruction following > 4K context window,…
Two new AI releases by Apple today: 🧚♀️ OpenELM, a set of small (270M-3B) efficient language models. Weights on the Hub: Pretrained: huggingface.co/collections/ap… Instruct: huggingface.co/collections/ap… 👷♀️ CoreNet, a training library used to train OpenELM: github.com/apple/corenet
Apple is joining the public AI game with 4 new models on the Hugging Face hub! huggingface.co/collections/ap…
Towards Large Language Models as Copilots for Theorem Proving in Lean - Opensource all codes under MIT license - Shows effectiveness in assisting humans and ATP process compared to existing rule-based proof automation repo: github.com/lean-dojo/Lean… abs: arxiv.org/abs/2404.12534
llama3 has superior in-context learning. llama3 responds well to SFT with error feedback dataset. really happy with how my SFT turned out (after 2 fails) on my multi-turn error and improvement feed dataset. this is what sets it apart from all other prev. OSS models - ability to…
Tomorrow in the reading group we discuss "Smooth, exact rotational symmetrization for deep learning on point clouds"! arxiv.org/abs/2305.19302 Join us at 11am EDT / 5pm CEST on zoom: portal.valencelabs.com/logg
Wake up babe Alibaba just dropped a new SOTA Apache 2 embedding model. 434M params, 57.91 MTEB retrieval score, 8192 token context length, transformer++ encoder backbone (BERT + RoPE + GLU).
Trends for United States
You might like
