What’s next? Language unlocks potential capabilities beyond accuracy:
🔓 Open-vocabulary prediction: extend to new diagnoses with minimal tuning.
🔍 Natural language slide search: e.g. "slides showing interface dermatitis with basal vacuolization"
🩺 Further enrichment with case-specific clinical context
Full blog post: pathai.com/blog/advancing…#DigitalPathology#ComputationalPathology#HealthcareAI#PLUTO4#MultimodalAI
Looking deeper into the the shared embedding space, it has clinically meaningful structure:
🟢 Subtypes cluster together
🟤 Inflammatory dermatoses separate cleanly from melanocytic lesions
Slide embeddings mirror text embedding organization, showing alignment across modalities, not just within them.
🔬 Moving Beyond Pixels: Advancing Multimodal Pathology
Pathology AI has long relied on images alone. What happens when you add language?
We combined PLUTO-4 vision embeddings with rich histological descriptions to build a joint vision-language space for disease classification, and the results are promising.
🧵 #AI#MachineLearning#Pathology#MultimodalAI#FoundationModels
These results highlight how our PLUTO-4 foundation models enhance PathAI’s AI-pathology products across digital diagnostics and translational research.
We’re excited for the new capabilities PLUTO-4 will unlock for our partners and the community!
📄 Learn more in our technical report:
👉 arxiv.org/abs/2511.02826#AI#Pathology#HealthcareAI#FoundationModels#PLUTO4
Beyond public benchmarks, PLUTO-4 shows real-world impact —
🩺 ~10 % improvement across multiple PathAI products, with strong gains in dermatopathology specimen classification.
These advances bring us closer to robust, generalizable FMs for pathology applications.
#Dermatology#HealthcareAI
🚀 Excited to share PLUTO-4, our new state-of-the-art foundation models for pathology! 🔬
We’re seeing SoTA performance across multiple public benchmarks (EVA and HEST) — surpassing other leading pathology foundation models. (1/6)
#AI#MachineLearning#Pathology#FoundationModels#HealthcareAI
The opportunity to standardize the way we construct data sets is important...If we try to build a data set for every use case, we can set ourselves up to fail. We don't want to build a large reference data set that doesn't get used - @balasubramaniac from @Path_AI#FriendDx
🔍 Interpretable concepts found using SAE
- SAE trained on PLUTO embeddings disentangled polysemantic features. Single dimensions captured distinct concepts:
✅ Cell types (e.g., cancer cells, red blood cells)
✅Geometric features (e.g. edge of tissue)
✅ Artifacts (surgical ink)
Monosemantic representations
- Single SAE dimensions correlate with counts of single cell types. For example, SAE-1736 represents plasma cell abundance exclusively
- The findings generalized to:
✅ Out-of-domain datasets (CPTAC)
✅ Different stains (H&E, IHC)
✅ Various scanners
PathAI #MachineLearning engineers have
recently published new #AI findings for mechanistic interpretability of PLUTO, a pathology #foundationmodel. Using sparse autoencoders (SAEs), we uncovered biologically meaningful and interpretable features. 🧵
arxiv.org/html/2407.1078…
🔬 Impact
This study shows the promise & potantial of SAEs in explaining foundation model behavior for medical imaging. Interpretable features unlock:
- Potential for clinical AI 🏥
- New biological insights 🧪
🔗 Read the full work: bit.ly/4gl20xZ#AI#Pathology
47K Followers 8K FollowingVP for Research @JohnsHopkins, T.H. Smoot Professor @HopkinsEngineer & @HopkinsMedicine, Co-founder @INBT_JHU, Lab: https://t.co/9OtmgB6InU Tweets are my own.
6K Followers 2K FollowingYoung, Enthusiastic Practicing NextGen Pathologist from Italy, Molise! Love Sci-Fi, Oriental Mind, India, Kraut Rock, Tennis, Biology, Travel, Cultural Exchange
32K Followers 30K FollowingCrypto | Web3 | Casino & iGaming | AI | Former CM Manager @MetaGoons | Betting on the future, one block at a time | DM for Collabs |
2K Followers 7K FollowingAlbconsultingluxe Recrutement Formation Consulting Ancienne directrice commerciale internationale ancienne élue communautaire sud sainte baume Var Human Centric
745 Followers 4K Followingkeepin it real in AI x Bio.
single-cell genomics 🧬
bikes, bulldogs, everything brazilian.
ex-genentech | ex-ucsf | ex-lcg unam 🇲🇽 🐾
21K Followers 2K FollowingUnited States & Canadian Academy of Pathology (USCAP)
Advancing pathology through education, collaboration, and community
@ModernPathology @LIjournal
17K Followers 2K FollowingReporting on the research, innovations, personalities, and policies that shape #pathology 🔬 Editor: @patholo_brist Deputy: @JessicaATexere
6K Followers 441 FollowingThe DPA encourages sharing of best practices & promotes use of the technology in order to demonstrate efficiencies, awareness & its benefits to patient care.
360 Followers 384 FollowingPathology News is a scientific blog, news, careers, events, buyer's guide and product review site, specializing in digital and computational pathology.
469 Followers 395 FollowingResearch Laboratory for Digital Pathology and Human Factors in AI @ Medical University Graz
#digitalpathology #exAI #causability
180 Followers 703 FollowingCOO, @s2sPRComms | Supporting startups so they can change the world. Previously: @Pacsci, @Fox13Seattle. Yes, it's my real name. Here to learn.
10K Followers 3K FollowingAuthenticity in #genomics #bioinformatics. #scicom, @officialATCC #gaming #DnD #EDM #punk @ Home ♟👾🎮 🎸he/him // I may unfollow you if you post dumb politics
32K Followers 788 FollowingMD, PhD, Medical Oncologist | Clinical Fellow @DanaFarber | @Harvard. Associate Editor @ESMO_Open. Interested in breast oncology, HER2, ADCs and good music.
74K Followers 25K FollowingThe Boston region's source for local business news & events. Part of the American City Business Journals network. Subscribe today! https://t.co/I8dEe5inYZ
24K Followers 16K FollowingBoston Business Journal regularly produces special events to recognize industry leaders & facilitate professional networking. For news, follow @BosBizJournal
62 Followers 97 FollowingAgents @Meta
Prev foundation models for healthcare @PathAI @UCBerkeley
https://t.co/qkvD89ZPnc
Views are my own, not my employer's
5K Followers 5K Following🇺🇸Cali Common Sense Conservative🇺🇸 “Only the truth of who you are, if realized, will set you free.” E. Tolle ⁉️Who are you…..really? 🏊🏻♀️🧘♀️🏂🚫DMs
7K Followers 1K FollowingWe foster a collaborative, inclusive, & prosperous innovation ecosystem on behalf of New England's VC industry. Launched @Unpitch, #NEVYs, and more
72K Followers 198 FollowingAt Gilead, we set – and achieve – bold ambitions to create a healthier world for all people. Read more: https://t.co/TZWHS6iRTe
183 Followers 152 FollowingSenior Product Manager at Spotify, specializing in data & machine learning products. Passionate about using tech to improve user experiences.
112 Followers 764 FollowingResearcher and engineer by profession; dancer/philosopher at heart; ML engineer @GetSift; Opinions are my own and not the views of my employer;
386 Followers 965 FollowingFoundation Models for drug discovery. Staff Machine Learning Scientist at Spring Science (ex: PathAI, Philips Research, Microsoft Research). PhD ML.