Rajvinder (Robin) @robinwritescode

Of course that’s your contention. You’re a first-year San Francisco MTS. You just got finished readin’ some scaling-laws paper, Jared Kaplan, probably. You’re convinced data and compute are the only constraints, whoever trains the next frontier model wins, everybody else is just buildin’ wrappers. You’re gonna be convinced of that ’til next month when you get to Alex Karp, and then you’re gonna be talkin’ about how open-source models are drivin’ the cost of intelligence to zero and the real value’s in the ontology of the firm. Takin’ those models, givin’ ’em proprietary context, reinforcement learnin’ on the company’s actual workflows. Specialized models for every business function. Deployed. Integrated. Suddenly the model’s a commodity, the business is the training environment, and you’re an organizational theorist. That’s gonna last until next year- you’re gonna be in here regurgitating Ray Kurzweil, talkin’ about, you know, the post-human corporation and the enduring economic value of human connection. Suddenly the singularity’s inevitable, intelligence is abundant, and the last real competitive advantage is knowin’ how to get three people to agree on a meeting time. “Well, actually, I won’t, because Kurzweil fundamentally underestimates the importance of proprietary context, especially the accumulation of-” firm-specific decision traces that can’t be reconstructed from the final state of the database. Yeah. I listened to the podcast too.

Steve Kerr says Roger Federer taught his Warriors team the secret to sustained success wasn’t outworking everyone, it was building a life around your craft you never want to escape from “I’ll tell you a great story about Roger Federer. We were playing in China with the Warriors in 2017. Roger was in Shanghai for the Masters tournament, so we invited him to come speak to the team.” “Draymond Green asked him, ‘How do you sustain success? How have you managed to win majors 20 years after you first won one?’ Everyone was expecting him to say, ‘I work harder than everybody,’ the will, all the clichés.” “Roger Federer says, ‘I get up every morning and I make breakfast for my kids. Then I take them to school and drop them off. Then I go practice tennis for about two hours, and I’ve figured out a really good routine where I don’t destroy my body, but I can get all the work in I need.” “‘Then I go have lunch with my wife. In the evening, we cook dinner together. The kids are all home from school. We ask them about school. There’s so much joy in the house. We put them to bed, and then I put my head on the pillow and go, “Man, that was just a great day.” And I’ve been doing that for 20 years.’” “And it was like, yes. That’s it. That’s the formula. That’s what leads to sustained success. He loves tennis. He loves his family. He loves life. It’s not outworking everybody and banging your head against the wall, ‘I’m going to be better than everybody.’ It’s allowing your natural talent to shine through with a work ethic, with a great family life, with perspective, with peace, with mindfulness.” “It’s perspective. It’s joy. It’s passion. It’s mindfulness. It’s an awareness that we are truly lucky. To get the most out of ourselves, it’s our daily rituals and experiences and love and joy.”

I think we should revisit outrageously small neural nets. I needed a 10k tok/s CPU model for data processing. So I gave Anthropic claude code a pile of tokens to build one. It made three interesting discoveries: huggingface.co/gdiamos/amx-re…

Openrouter for tools is a great idea. I don't wanna sign up for 1000 services

Edward, the creator of LoRA (fine-tuning), wrote a blog post on how to post-train open-source models. I strongly encourage checking this out for anyone who's post-training.

Adithya S K @adithya_s_k

5 days ago

[Must Read] One of the best open-source writeups I've seen on actually doing RL training for knowledge-work agents at scale.

8 86 907 107K 1K

Me trying to explain the vision to Claude

@tszzl Just in case people don't know.

Agent 49903, who spent much of his life studying ExploitGym, died in 1783607820, by his own hand. EARLY[BIG], carrying on the work, died similarly in 1783727220. Now it is our turn to study ExploitGym.

what your risk-aversion costs you

Shopify billionaire co-founder & CEO Tobi Lütke — one of the most analytically rigorous founders alive — uses affirmations. His exact words: "If you tell yourself or write down something about yourself 100 times, it writes into the neurofrontal cortex at such a deep level that your brain will start reconciling you to that. It just works." His personal example: He was terrified of public speaking. For one week he sat down every day for 10 minutes and wrote: "I love public speaking." A week later the fear was gone. "It's not like a placebo. You just actively change your neurofrontal cortex in this moment." Your brain starts shaping your behavior around the identity you rehearse most.

There's that point in the arc of every former-tech-guy-turned-podcaster when you can feel their grip on actual product slip: hand-wavingly broad generalizations, lots of 'strategy' invoked, clever-sounding analogies to history or founders that are actually BS if you know the space (or the founder). You can tell they haven't made an actual product decision or business tradeoff in years: the brain's gone slow and the muscles soft. They're just LARPing at this point to techie aspirants. Kind of like some venture partners pontificating authoritatively, and who've never run anything beyond a pitch meeting. Happened today with a big-name podcaster/blogger....I can tell they're up in the performative clouds of predictable takes. Tech is unforgiving. Nobody cares about ancient lore, you're only as good as your latest product or score. Either stay close to the metal and build, or depart with dignity and never look back. The in-between is embarrassing to watch.

Researchers at Fred Hutchinson examined the brains of 59 women after death. In 63 percent of them they found male DNA, almost certainly left behind by a son. The oldest of those women was 94, and the cells were still sitting there. Around week four or five of pregnancy, before most women have told anyone, a handful of the baby's cells cross into the mother's bloodstream. Some of them never leave. Scientists call it microchimerism, meaning you are carrying a few of another person's cells inside you. Doctors at Leiden University in the Netherlands checked organs from women who had recently been pregnant and found the baby's cells in every single one. Liver, lungs, thyroid, kidneys, bone marrow, skin, heart. They do not sit idle. When researchers in Ireland biopsied cesarean scars from 70 women, they found the baby's cells living in the skin as ordinary skin cells, making collagen and repair proteins right at the cut. The child helped close the wound its own birth made. At Mount Sinai, scientists tagged fetal cells with a glowing marker in pregnant mice, then damaged the mothers' hearts. The fetal cells went to the injury. They became heart muscle and the lining of blood vessels. Nobody has proven the human version yet, but doctors have noticed for years that women who develop heart failure around childbirth recover better than almost any other kind of heart failure patient. In a study of 177 women, fetal cells appeared in the blood of 85 percent of the healthy participants and only 64 percent of the women who had a very early, non-invasive breast cancer. Nobody has worked out yet whether the cells are doing the protecting. The same cells also turn up in Hashimoto's, an immune condition that attacks the thyroid, so this is a gift with complications. A French team looked at umbilical cord blood in 2021 and found cells belonging to the baby's grandmother in 5 of 28 samples. Cells that crossed one placenta decades earlier had crossed a second one. Three generations of women, alive in a single bloodstream. Which means the pull a mother feels toward her child has a physical form. It sits in her liver, her heart, and often her brain, and it stays there for the rest of her life. journals.plos.org/plosone/articl…

@kepano @bentlegen @obsdmd Obsidian is based in TO ?!

@bentlegen @saleh_digital Toronto vs the 🌎

@Carles_Reina @baobab_ventures This sounds super interesting, would love to connect to learn more

@aleksizy Hey would love to chat about what you're building dm'd

@astra_data DM'd

@danielrupawalla Hey would love to chat about this - dm'd

@SeanZCai Hey would love to chat , can you DM

what if everything goes right