Sridhar Ramaswamy @srics
Co-founder, Head of Engineering @ https://t.co/FGoFN6N7O9 Gen-AI Data Security, Distributed Systems, UC Berkeley, CEG - Guindy. The journey matters! medium.com/@sridhar_ram/ SF Bay Area Joined January 2009-
Tweets445
-
Followers211
-
Following764
-
Likes830
Usual SecOpsy habits while getting ready to work with NVIDIA NIM api inference endpoint. Perhaps needs a landing page or a redirect to something prominent?
Such a prominent URL from a $4.5T company missing a SAN in its X.509 cert? api.nvidia.com @nvidia
@deedydas For us, hybrid RAG has been the default for more than a year now - both dense vector search + BM25 to pull the right candidates for further processing/pruning (for relevancy, staleness, cost, etc)
Same here. claude sonnet was the dependable workhorse last many months. Now, regularly swapping with GPT-5 with a lean towards the latter. Primary issue with sonnet, it is too agreeable (even with explicit hints in cursor-rules). gpt-5 is bolder, gives dissenting note to steer design/code in another direction which I appreciate.
Absolutely! One further nuance, could be “prompt engineering” is for humans whereas “context engineering” is for AI agents & apps.
+1 for "context engineering" over "prompt engineering". People associate prompts with short task descriptions you'd give an LLM in your day-to-day use. When in every industrial-strength LLM app, context engineering is the delicate art and science of filling the context window
Transition to AI-enabled business will come down to this ... economics, ROI, and human retooling.
also, here is one part that people not interested in the rest of the post might still be interested in:
As we hit limits of existing LLMs and LRMs, new model architectures will emerge! Remains to be seen who will be winners & losers of the next AI wave
The Illusion of Thinking in LLMs Apple researchers discuss the strengths and limitations of reasoning models. Apparently, reasoning models "collapse" beyond certain task complexities. Lots of important insights on this one. (bookmark it!) Here are my notes:
For Enterprises, this is the next 5 years worth of feature requirements in one tweet. That's an optimistic estimate :) Both people and enterprise business processes need to co-evolve for this generational change in how human <-> software interacts.
Products with extensive/rich UIs lots of sliders, switches, menus, with no scripting support, and built on opaque, custom, binary formats are ngmi in the era of heavy human+AI collaboration. If an LLM can't read the underlying representations and manipulate them and all of the
The convergence is elegant! #Platoism
Huh. Looks like Plato was right. A new paper shows all language models converge on the same "universal geometry" of meaning. Researchers can translate between ANY model's embeddings without seeing the original text. Implications for philosophy and vector databases alike.
Microsoft continues to embrace open standards - Empowering multi-agent apps with the Agent2Agent (A2A) protocol proposed by Google #AIAgent #MCP #A2A #Microsoft microsoft.com/en-us/microsof…
An iPhone moment might be on the horizon for AI with this announcement of OpenAI and Lovefrom/IO coming together with legendary Jony Ive and @sama ... while the forgettable Humane AI pin came & went, waiting to see what unfolds from this legendary combo openai.com/sam-and-jony/
Agentic memory that survives and accessible across multiple MCP enabled apps is powerful. Need to check if any scope or auth check available to guard the gates - for privacy and security guardrails.
We’re excited to launch OpenMemory MCP, a private memory for MCP-compatible clients powered by @mem0ai Today, most AI assistants and dev tools operate without memory. You plan your roadmap in Claude, implement tasks in Cursor, but none of them know what the other did. Each tool
@goodside Cutoff plays out in weird ways. It is funny how it "thinks" OpenAI proposed MCP before further prompts trigger search to correct itself!
Unpacking the economics of DeepSeek and comparing it with US AI models, say, Claude Sonnet 3.5's build cost. Perhaps it is comparable in cost *but* the kicker ... DeepSeek is opensource with an MIT license. Even Llama license comes with strings attached #DeepSeekR1
These four points on DeepSeek seem very likely correct and important to understand about the economics of building AI models and what DeepSeek actually did. .
Amazing benchmark numbers! Token economics would dictate o3-mini as the model to build products around.
Today, we shared evals for an early version of the next model in our o-model reasoning series: OpenAI o3
I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵
A significant milestone in OpenSource with a frontier AI Model. It might well be the watershed moment à la Unix ruling the OS landscape. It will take few iterations and some significant GPU $$$ by downstream efforts to produce a "Linux" like community maintained frontier model. For now, let's cheer @AIatMeta for a great move 👏
Starting today, open source is leading the way. Introducing Llama 3.1: Our most capable models yet. Today we’re releasing a collection of new Llama 3.1 models including our long awaited 405B. These models deliver improved reasoning capabilities, a larger 128K token context
This is where we are heading. Some portion of our computing needs can switch to use such Cognitive Processing Systems. We need some initial killer use cases to light up this transition. I still believe Apple with its ability to hear (microphone), see (camera) and show (display) using it devices and it’s UX mastery will be the first to crack this!
100% Fully Software 2.0 computer. Just a single neural net and no classical software at all. Device inputs (audio video, touch etc) directly feed into a neural net, the outputs of it directly display as audio/video on speaker/screen, that’s it.
@AIatMeta and @ylecun making AI accessible for a broader set of users and architectures. I hope it becomes the de facto “Linux of AI”
Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and
Trends for United States
You might like
