-
Tweets3K
-
Followers516
-
Following3K
-
Likes12K
"Building a Large Language Model from Scratch" is in the final stages. I'm currently working on Chapter 6, finetuning a GPT-like LLM to classify SPAM messages. And while I'm polishing up the main content, I wanted to share some bonus experiments along with some interesting…
apres chase
Sulfates and their potential in preserving organics? And with examples from Earth too? Yep! A great paper by my colleague @KathyBenison in @jgrplanets
Sulfates and their potential in preserving organics? And with examples from Earth too? Yep! A great paper by my colleague @KathyBenison in @jgrplanets
Oh no, I have to rewrite a bunch of slides! Still excited.
Oh no, I have to rewrite a bunch of slides! Still excited.
All is open! LFG
@yacineMTB Clearly there are those in the tech industry without the self-awareness to realize how silly they look in a black turtleneck. It should have been retired after Jobs, like a jersey number
there's always a way. the only obstacle is the fact that you actually don't really want to do it. wake up
It's official! Apache DataFusion is now a top-level Apache project. 😃 github.com/apache/datafus… The URLs for the subprojects have also been updated. github.com/apache/datafus… github.com/apache/datafus… github.com/apache/datafus… Congratulations to the community for this big milestone!
We've just uploaded a GGUF of the 8b llama-3 instruct model on @NousResearch's huggingface org: huggingface.co/NousResearch/M…
I doubt that studying XZ will lead to any actionable improvement of security. Modern computing has a huge attack surface: No reasons the next bad actor would pick similar lines of action among almost infinite ones. So? More resources, less complexity, less dependencies.
Never underestimate the open source AI community. These cracked engineers are here to break the limits of what’s possible with local LLMs. We just witnessed some nutty inventions. Here’s what we saw at the @ollama Open Source and Local AI meetup at @cerebral_valley (🧵):
synthetic geo data with rational distributions seems good.
synthetic geo data with rational distributions seems good.
cognition diffusion progressing
cognition diffusion progressing
Just added pre-built CPU, CUDA, and Metal wheels for new releases of llama-cpp-python Installs insanely fast with uv (probably goes without saying) Still very new and experimental so lmk if you run into any issues
My three laws of robotics. The companies that I have founded have sold 50+ million real robots to real customers; research robots, home cleaning, nuclear power plant inspection, military ground robots, upper body humanoids in factories, and now at Robust.AI,…
In your opinion, what's the saddest line in a movie?
The Cerebras CS-3 redefines scalability in AI supercomputing. A 2048 CS-3 cluster can deliver an astounding 256 exaflops of AI compute. This makes it possible to train Llama2-70B in less than one day—a task that would take at least one month on gigantic GPU clusters. The entire…
Off to a promising start
In this case, it was an attack predicated on maintainer burnout. But for those that think the biggest issue in open source is vendor license changes, I'd recommend you look to more foundational issues.
In this case, it was an attack predicated on maintainer burnout. But for those that think the biggest issue in open source is vendor license changes, I'd recommend you look to more foundational issues.
This is the way
Mitchell Byars @mitchellbyars
41K Followers 17K Following Deputy city editor @dailycamera; #CUBoulder grad; Hawaii native surviving in a landlocked state with the help of beer, golf and snuggies. #ScannerFTWEric Budd @ericmbudd
10K Followers 10K Following the econ side of everything. Boulder political organizing https://t.co/pteqwwgbJM https://t.co/9zEGGTvQDt he/him get coffee? https://t.co/5plLmJoXR3Bekah (she/her) @bolderbekah
1K Followers 977 Following bikes, walkable neighborhoods, lots of Boulder/ Austin, sometimes music or tech https://t.co/nR98wtw4qVAaliyah Dimucci @AaliyDimucc
73 Followers 5K FollowingLaunchpad @LaunchpadBuild
1K Followers 1K Following Building self-programming robots to reshore manufacturing 🇺🇸AdaAnthony @R1pX15ZF1daT1
0 Followers 36 FollowingRosalind Tornincasa @TornincaRosali
90 Followers 5K FollowingKirby Nunnally @KirbyNunna91330
46 Followers 5K FollowingWinnie Bolde @winni_bo
28 Followers 5K Followingyahiabakour @mynameisyahia
2K Followers 1K Following No clickbait just vibes 📝 https://t.co/byfEq3eftV 🚀 🔪 https://t.co/GRsLSQ3lY8 | 20K MAU 📈 https://t.co/rvpPiKjwMw | 0-200K users (acquired) 🤖 https://t.co/1i62ULQtZL (acquired)Fatima @Fatima544386
467 Followers 3K Following More introverted so not good at socializing, do not have many friends, so I am trying to make new friends, hope to meet kind people or better relationshipsmaye musk @maye_musk_15
2K Followers 6K Following Bestselling international Author #WomanMakesAplan📖 Doctor of Diabetics 🧑🎓 supermodel 😉💃#ItsGreatToBe75AgentsArria Bingman @arr_bingm
49 Followers 5K FollowingJanna Quaglieri @quagli_jann
45 Followers 5K FollowingJulie Jones @JulieJo67340386
13 Followers 694 FollowingAvah Alphonso @AlphonsoAv14830
83 Followers 5K FollowingYelena Monteagudo @MonteagudYele
33 Followers 5K FollowingZola Mirabella @MirabellaZ86209
73 Followers 5K FollowingSavanna Rainha @savan_rain
80 Followers 5K FollowingJanna Saltern @jann_salte
63 Followers 5K FollowingFrank Pinnola 🇺�.. @frank_pinnola
671 Followers 896 Following fullstack + ml in healthtech || prev eng @getchargeapp CPE/CS & hackathons @followstevens || 🐇🏔Sharri Grode @GrodeShar
83 Followers 5K FollowingKaye Ficarra @FicarKa
41 Followers 5K FollowingMogomra (e/acc) @MightyMogomra
654 Followers 426 Following Mog-chan? He's the local appsmith, little smelly but he's friendly. They say he used to make VR display drivers in CaliforniaFlavio Brasil @fbrasisil
2K Followers 2K Following Effects Shepherd and Itinerant AI Magician he/himLaveta Gullo @LavetGu
78 Followers 5K FollowingRuby-rose Noss @NossRuby
73 Followers 5K FollowingBrendon 🌪️🐻�.. @brendonme
12K Followers 2K Following Tornado Wrangler | bad weather and mountains | high plains storm chasing | Wyoming etc | I don't study the atmosphere, but I live in it | accountant #wywxNeashon @neashon13350
119 Followers 3K FollowingSamantha Ochoa @ochoa30506
76 Followers 5K FollowingAiko Quartucci @aik_quartu
40 Followers 5K FollowingTom Bombadil @Authw8
571 Followers 971 Following If the bartender hitting me with a shovel is wrong, I don't want to be right. He/himDavid @Joybeanns
810 Followers 724 Following Tech Architect | CEO/Co-Founder of Nothing | Experimenting with AI | Making interesting content to keep up !Angelique Warp @angeli_wa
30 Followers 5K FollowingMathilde_Mo @MathildeMo90690
5 Followers 429 FollowingNoriko Rogian @rogi_nor
95 Followers 5K FollowingIvy-rose Westcoat @IvyWestcoa74555
98 Followers 5K FollowingArcee.ai @arcee_ai
250 Followers 189 Following Arcee is the leader in domain-adapted LLMs w/ our Small Language Models (SLMs) & our Model Merging innovations https://t.co/ZjIQuOcoknSabine Tarzia @SabTarz
51 Followers 5K FollowingDr. Jackson @cowtowncoder
2K Followers 524 Following Eco-liberal EU-expat (now in US PNW). Coder (Java), OSS author (Jackson, Woodstox, ClassMate, java-uuid-generator), collaborator, mentor. Gainfully employed.Pearlie Taing @pearlie6407
37 Followers 5K FollowingJuana @latsonjuana20
205 Followers 3K FollowingKelsey @wxkels
609 Followers 395 Following idk anything about the weather but I have a degree in it. Ok. bye.David @David02995430
141 Followers 1K FollowingEric Budd @ericmbudd
10K Followers 10K Following the econ side of everything. Boulder political organizing https://t.co/pteqwwgbJM https://t.co/9zEGGTvQDt he/him get coffee? https://t.co/5plLmJoXR3Nicole Speer @NicoleKSpeer
1K Followers 674 Following Scientist, mom, businesswoman, experienced leader, and champion for inclusion. 2023 candidate for first elected Mayor of Boulder. 🏳️🌈Kerry Donovan👩🏻.. @KerryDonovanCO
132K Followers 1K Following Colorado born and raised. Rancher. Former President Pro Tempore. Former State Senator. What’s next? Big @shadmurib fan.Jane Hummer: An Ameri.. @janehummer
899 Followers 2K Following "An advocate for pretty much all progressive causes. Other than that, she seems like a nice person." - someone on NextdoorBekah (she/her) @bolderbekah
1K Followers 977 Following bikes, walkable neighborhoods, lots of Boulder/ Austin, sometimes music or tech https://t.co/nR98wtw4qVAaron Gokaslan @SkyLi0n
3K Followers 345 Following Creator of the OpenWebText and OpenGPT2. @PyTorch Core Reviewer. PhD Student at @Cornell (interning at @MosaicML) Previously at @FacebookAI and @BrownUniversityLaunchpad @LaunchpadBuild
1K Followers 1K Following Building self-programming robots to reshore manufacturing 🇺🇸Mike Kelly @mikecodemonkey
2K Followers 2K Following CTO of MemberVault. Grumpy old PHP developer with an unhealthy obsession with coding, dad jokes, and Linux. https://t.co/vMGPI6QlYIAir Katakana @airkatakana
6K Followers 902 Following based postdoctoral researcher in ai and language learning enthusiast📍tokyoThat One ROTC Cadet @That_ROTC_Cadet
396 Followers 934 Following ROTC Cadet anti-communist conservative leaning centrist and professional Serb hater 🇺🇦🇭🇷🇺🇸. (my opinions do not reflect the DOD or the United States Navy)Jeff Lawson @jeffiel
46K Followers 155 Following Owner of The Onion. Entrepreneur, ex-CEO and cofounder of Twilio. NYT Worst Selling author.Jon Pretty @propensive
8K Followers 1K Following Supporting Scala through professional training and open-source software. Responsible for Magnolia, Fury, Scala World and Functional Africa.TracingWoodgrains @tracewoodgrains
22K Followers 1K Following Storyteller. CFP @TheBARPod. Pursue excellence. Eng/中文Julien Lange @julienlange
140 Followers 292 Following London-based academic. Interested in all concurrency-related things, theory and applications (e.g. #golang).Bernardo Toninho @bernpton
309 Followers 788 Following Associate Professor at @FCTNOVA doing research on PL / Type Theory / Concurrency. Formerly at Imperial College London. All opinions expressed here are my own.cloud @cloud11665
5K Followers 1K Following SIMD fan | ctf player | ex OI-er | accelerate. CEO and co-founder @figura_labs DM FOR PRIVATE BETA ACCESSSantiago Fraire Wille.. @santiwilly
187 Followers 211 Following Developer (py 🐍, rs 🦀, js, ts). Reading is a good habit I have. https://t.co/ppb6Z0HtFp https://t.co/EbpU9d4Dyj https://t.co/GKs6u2wPU4Process Compose 🔥 @ProcessCompose
20 Followers 0 Following Process Compose is a simple and flexible scheduler and orchestrator to manage non-containerized applications.David Flanagan @rawkode
13K Followers 2K Following On a mission to help developers & operators be successful with Kubernetes, Cloud Native, Rust, and Server-Side WebAssembly. He / Him / Husband / FatherDwayne Cranston @CranstonDwayne
647 Followers 342 FollowingSebastian Völkl @basti_vkl
4K Followers 937 Following Building AI software for space/defense to reimagine how complex hardware systems are built. @1517fund fellow. Founded @hackerBCI. e/accCrusoeCloud @CrusoeCloud
228 Followers 14 Following Aligning the future of computing with the future of the climate. A carbon-reducing, low-cost GPU cloud platform by @CrusoeEnergy.Hamel Husain @HamelHusain
23K Followers 2K Following Researcher focusing on LLMs: https://t.co/iVZDFdIQiE Previously, dev tools and infra for ML. Ex @Github, @Airbnb, @DataRobot. @fastdotai core contributor.Reed Strength @CoachGeoffReed
22K Followers 410 Following Dunk Dad | ATG Coach ➡️ Access my “Weekend Warrior” training programs on the ATG App https://t.co/wEIp9WoVvB | Follow me on IG: @reed_strengthGroq Inc @GroqInc
45K Followers 468 Following Creator of the LPU™ Inference Engine, providing the fastest speed for AI applications, designed & engineered in N. America https://t.co/DsEqVAC5DpGunnar Morling 🌍 @gunnarmorling
51K Followers 302 Following Software engineer @Decodableco · Ex-lead of Debezium · Spec lead of Bean Validation 2.0 · Creator of JfrUnit, kcctl and MapStruct · Java Champion · 🚴Lamini @LaminiAI
5K Followers 9 Following The enterprise LLM Platform that you can own. Run and train custom open models today.TensorWave @TensorWaveCloud
589 Followers 622 Following Power up your AI with the leading GPU cloud, featuring AMD Instinct™ MI300X. First-to-market MI300X launch partner with GPUs available and ready to utilize now!Brendan Schulman @RobotPolicy
2K Followers 217 Following Vice President of Policy & Government Relations at Boston Dynamics. Former VP of Policy & Legal Affairs at DJI. Personal views only. Also find me at @dronelawsRoss Taylor @rosstaylor90
6K Followers 869 Following Something new 🥷. Previously: @paperswithcode, reasoning lead @metaai, Galactica LLM lead, Atlas ML (acq by Meta)Vincent Murphy @brainstormvince
3K Followers 3K Following Wide eyed on AI & clear-eyed on what AI exponentiality means for all of us and everything.Daniel Hooper @DanielcHooper
8K Followers 217 Following Systems/graphics programmer making @PrincipleApp Before that: Engineer on @Apple Camera and PhotosFabrizio Balliano @fballiano
653 Followers 524 Following Senior web engineer, 5x Magento Certified, OpenMage maintainer.Handika Wisnu @handikawisnu
113 Followers 321 FollowingJoey (e/λ) @shxf0072
2K Followers 386 Following I speak fluent Python and Sarcasm. researcher at @NousResearchsimp 4 satoshi @iamgingertrash
15K Followers 520 Following personal agi @itsalltruffles prev: @HF0Residency, Swype, @scale_ai, @uoftDr. Ryan French @RyanJFrench
6K Followers 631 Following British Solar Astrophysicist at @NatSolarObs ☀️ Author of 'The Sun: Beginner’s Guide to Our Local Star' (he/him). Prev @UCL - (views my own)stacy 🌤 @voidshapes
1K Followers 489 Following lifelike automata 🌗 mutation hunter working on aging & longevity / phd candidate @ucberkeley. I do all my own stuntsJess @Punished_Jess
2K Followers 145 Following Spaceflight Enthusiast // Avid KSP Player // Alternate History Enjoyer // Space Shuttle's #1 Fan // Lesbian // She/Her NCR-Brotherhood War Veteran 🇺🇸Frank Pinnola 🇺�.. @frank_pinnola
671 Followers 896 Following fullstack + ml in healthtech || prev eng @getchargeapp CPE/CS & hackathons @followstevens || 🐇🏔Henning Sittler @HenningSittler
243 Followers 319 FollowingNils Reimers @Nils_Reimers
10K Followers 434 Following Director of Machine Learning @Cohere | ex-huggingface | Creator of SBERT (https://t.co/MKKOMfuQ4C)Martin Shkreli (e/acc.. @MartinShkreli
167K Followers 3K Following https://t.co/lzin5ByH0t [email protected] https://t.co/oMIiyJcIzk https://t.co/DuU6MMqcgQIncredible work by storm chasers, streamers and meteorologists during the tornado outbreak yesterday for increasing awareness of the incoming dangerous tornadoes. Thank goodness for no loss of life yesterday despite so many destructive storms.
Hot take but it’s never been a time where it has been easier to bootstrap good quality web scale search. Yes, it costs infrastructure but never has there been a better opportunity to take on G in quality.
I know it's like 2 weeks late now, but the Valkey project did finalize on a logo created by @ziyangio. It's simplicity plus the key reference is what sold it. There was some other great ideas in github.com/valkey-io/valk…, but we finalized on the one with the most upvotes (❤️ + 👍).
dolphin-2.9-llama3-8b-256k is released. It is dolphin-2.9-llama3-8b with @winglian's awesome 256k context adapter applied. I will get the model card done today.
Just did a dry run of my @nixos_org talk to the family! To my surprise, they loved it and paid attention the whole time lol. Next stop, @lfnw. If you're there, catch this talk at 10am Sunday.
I published my filtered and uncensored dataset for Dolphin-2.9 on @huggingface so if you wanna make your own spin on Dolphin, or just see how Dolphin is created, you can check it out. Thanks to all the upstream dataset creators for open source data! huggingface.co/datasets/cogni…
I've poured my mind, heart, and soul into understanding these complex interactions. This is just the beginning, but I could not be more proud to say that it works ✅️
Supercell near Lincoln #newx may pose a heightened tornado threat after final cell merges into its forward-flank, while another cell remains in its rear flank.
Incredible tornado intercept just now north of Lincoln Nebraska!! @ryanhallyall @SevereStudios
@aurelievache Huh? Isn't it more readable when the stages are indented? 😳
I LOVE CONVECTION AND VERTICAL WIND SHEAR
Unbelievable video of a wedge tornado in Nebraska. Video from Scott Hollinger.
should i cancel netrunner (remove from list of notable accelerationists on e/acc wiki) for running a scam ? poll in replies
People are about to lose all hope in both e/acc and decentralized AI due to the complexity of this scam being run by one of the top e/acc community members who managed to frequently get quote-tweeted by top people in the space. This is the perfect storm of madness. PS: The…
6 months ago I bought M2 Ultra 192GB to play with local fine-tuning of LLMs. I was so excited and happy 😁 After few days spent fighting with Pytorch, MPS, poor support for anything AI related, getting terrible and slow results, I was desperate 😭 But then MLX arrived! 🌈 And…
Quantized matmuls in the latest MLX are up to 40% faster thanks to @angeloskath and @DiganiJagrit QLoRA fine-tuning Llama 3 70B on a single M2 Ultra stats: - Batch size 4 with 16 LoRA layers - 95 toks/sec - Peak mem 41GB - Avg power 120 W
Circling back to this now that all the reports from yesterday are in. Eckley is the purple (attempt at a) star. Neat.
Today's hypothetical target: Eckley, Colorado. Western Kansas could easily be special too but multiple CAMs and environmental trends point to one or two supercells crossing Washington and Yuma counties this afternoon into the early evening.
@iCyclone @JordanHallWX @SevereStudios Thanks Josh!!😁🫶🏻Hahaha it was their first storm chase, helluva day to see their first tornado! 😂
Cool stuff, we found a similar result back in December arxiv.org/abs/2312.01037. Kind of upset they didn't cite/link to us tbh.
New Anthropic research: we find that probing, a simple interpretability technique, can detect when backdoored "sleeper agent" models are about to behave dangerously, after they pretend to be safe in training. Check out our first alignment blog post here: anthropic.com/research/probe…
@yacineMTB my idea was a rack-mounted Mac Pro with 2 groq LPUs at $55k:
Personal AGI hardware is here!? Priced it out and a rack-mounted mac pro is $7500. Not bad when it can handle 2 of these bad boys: mouser.com/ProductDetail/… These are the groq lpu cards. All in your looking at ~$55k for your own local chatbot. 😂 Of course you'll probably want a…
Surprised Pikachu.
The end game for the German Greens. 'Green officials from ministries deliberately falsified expert reports. They obviously wanted to push through the nuclear phase-out at any price, if necessary against all economic and scientific reason.' berliner-zeitung.de/politik-gesell…