The % of government spending going to tokens will inevitably increase dramatically
Do we think that increases or decreases the efficiency of government spending?
Introducing Precursor Labs: a research company studying the infrastructure for collective intelligence.
The next generation of autonomous systems will need to coordinate, reason under uncertainty, and allocate resources in dynamic environments. We're working on how. ↓
easiest way to convince yourself that maybe yann lecun was cooking is to read ECHO from @DimitrisPapail and then ask “cool! can we do this for multimodal models next?”
@googrish ever played around with inverse RL/assistance games for yourself or customers? the idea of the model learning a hidden reward function based on behavior patterns seems quite interesting
Dario: We can't let China use frontier AI authoritatively, and we need to avoid prisoner's dilemma defection in an AI race.
Also Dario: Uses frontier AI authoritatively, and defects in prisoner's dilemma with OpenAI.
The AI safety community constructed a memeplex in which “taking AGI seriously” was a prerequisite for being a serious and good person. When inside this memeplex (as many at Anthropic, some at OpenAI, and a few at DeepMind are) your vision narrows until the world feels extremely
The streets are saying we will have a Mythos-level open weights model by October.
Around end of the year the money printer will start to really rip once its clear we need to outrace China on energy and compute buildouts so they can't keep catching up via distillation and algorithm commodification.
Usually it's somewhat difficult to get a good ROI on printing money even if you have currency dominance but GPUs + energy in an RSI era seem pretty slam dunk.
As a result, AI supply chain stocks will resemble frontier model intelligence charts, up and to the right, through 2027 (and likely 2028 for the election).
(SPCX unlocks largely end in December of this year, which also maps to crypto bottom, start saving)
Some sobriety should come in around 2029. AI will not have taken over even though people expected it to like 2 years ago, but now the labs are out of excuses. (The reason will likely be that more tightly scoped, esoteric reward modeling prevents "actual" economic surplus).
AI persuades better than any human can, because its arguments have higher fact density, which has a 0.9 correlation with persuasion. (intuitively checks out)
My read is that its exhausting to talk to AI because RLHF implicitly rewarded fact density and that continues to accelerate with RLAIF.
New w/ @AISecurityInst & @UniofOxford:
Frontier AI can now out-persuade expert humans in conversation - incl. world-champ debaters and professional canvassers.
This held even when humans chose their topics, prepared in advance, and competed for £1,000 prizes 🧵
Didn't think I'd get this far. Here goes:
- need to be able to quickly write down thoughts/ideas on mobile (one button click) and have it sync across devices. this should go to a default note that i can then parse later as needed into my more structured notes.
- need better UX of structuring multiple note files where lines in one notes file can point to either a full other note or specific line in another note file (basically obsidian's value prop, but their random hashes are gross)
- absolutely 100% need git on the set of notes. otherwise I start hoarding ideas to not lose them and the product becomes cluttered and useless.
- the AI should be able to read/fetch git history as needed (perhaps a toggle) to answer questions/propose next steps, I just don't want to see it on my view
- dont want 'sources' directly. i want my notes, which will be interleaved with links i drop in. the AI should index the content of those links as needed, as well as my ideas, as the default. (i know i can make notes sources but its clunkier imo)
- would be amazing if notebookLM could parse gemini chats when i drop those links into my notes. a lot of the time i'll talk to gemini to research something, then throw the chat link into obsidian so I can reference it later, but there's no existing solution for me to be able to later talk to an AI that has background context of a set of chats
- finally, want to be able to share my entire set of notes on a premade UI like Quartz, along with the git history sorted by most recent first, so that people can easily understand what I'm working on. even better if they have access to the AI chat as well to interact with my process.
There's also a ton of more 'vision' features I want, orbiting around CIRL/interactive learning, passive context collection, making the answering AI more agentic, social networking around the shared context/ideas, agent to agent collaboration, but that comes later. As a simple example, giving the AI a secure VM that it could code up small experiments on. I'll often a read a paper and want to implement a simple version of the ideas but the friction is so high. And obviously I'd want this to be auto-shared.
Overall, I'm trying to maximally expose the process of my work so that AI can be maximally useful to me, now and in the future. So much friction associated with getting my granular context persisted and legible in real time. I think Obsidian does decent with note taking, sharing, and git persistence if you set it up, while NotebookLM does well with AI augmentation and link parsing. At a high level, I think what's needed is largely an Obsidian frontend but NotebookLM backend.
Here is the technical report on SubQ 1.1 Small.
subq.ai/subq-1-1-small…
This is the second iteration on our Subquadratic Sparse Attention (SSA) model, and the first to be deployed with design partners in the coming weeks.
The results are compelling and verified by
been beating this drum since early 2025, seems like people are starting to see why it's so important :)
RL works -> "train or get trained on" -> open models + post-training infra are the path to institutional flywheels + democratization of AI progress
Can’t get over the fact that enterprises “doing their own RL” feels like the equivalent to businesses “building their own railroads”. One difference is obviously that open source models have no railroad equivalent. Another difference is that my own railroad would at best likely be the same as an existing railroad, whereas custom RL promises to improve performance.
subagents, teams of agents etc. will be first class citizens soon (if not already)
two things here:
1) you want to maximize token efficiency even more
2) training/serving on your own harness gives you an even bigger boost than before
benchmarks in the opus 4.8 model card show
510 Followers 3K FollowingChief Creative Technologist - Building AI content agents for media companies , former vfx supervisor, media prod. company owner - CTO&CCO of https://t.co/1UiRn3yvV9
146 Followers 1K FollowingDirector of Innovation at Odyssey Therapeia, Bridging the brain with everything else. Neuroscience, Artificial Intelligence, and Biotechnology. Always learning.
589K Followers 52K FollowingSan Francisco/Silicon Valley AI | Robots, holodecks, BCIs, analysis of new things | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future.
1K Followers 781 Followingpassionate about art of communication
SDR lead @sherlockdefi prev. head of eco @empe_io,
lead BD @coinstructweb3, host @SafeYieldClub, lead BD @TYMIOapp
7K Followers 230 Followinghumans& co-founder. professor of natural and artificial intelligence @Stanford. (@StanfordNLP @StanfordAILab) ex: Google DeepMind, UberAI
263K Followers 182 FollowingCo-founder of Thinking Machines Lab @thinkymachines; Ex-VP, AI Safety & robotics, applied research @OpenAI; Author of Lil'Log
45K Followers 362 FollowingProfessor @ Tsinghua, Founder of https://t.co/3IaQ4CI5W3.
AGI, LLM.
“The value of a man should be seen in what he gives and not in what he is able to receive.”―Einstein
4K Followers 465 FollowingMax Palevsky Professor of Sociology, Computational & Data Science @UChicago, Santa Fe Institute, & Google tweeting about science, technology, and AI in society.
65K Followers 59 FollowingStudent of mind and nature, libertarian, chess player, cancer survivor. @ Keen, UAlberta, Amii, https://t.co/u8za2Kod54, The Royal Society, Turing Award