Databricks @databricks

Lakebase brings operational databases into the same governance layer as analytics. This walkthrough explores what happens when Backstage, Spotify’s open-source internal developer portal, runs with Unity Catalog governance across ephemeral Postgres branches. What changed: • Access controls, audit trails, row-level security, and masking policies applied automatically across branches • Branch creation, deletion, and cost attribution traced with a single SQL query • Developers safely created isolated database branches without exposing sensitive production data databricks.com/blog/backstage…

🛠️ Building apps should be fast. Managing infrastructure shouldn’t slow developers down. Watch @andrelandgraf from Databricks and Kevin Niparko from @cursor_ai walk through how to build and deploy a production-ready app on Databricks using built-in governance and serverless Postgres. You’ll see how teams can: ✓ Prototype and iterate in real time ✓ Branch, scale, and manage transactional data ✓ Govern data securely with SSO and Auth ✓ Deploy apps where their data already lives Watch the on-demand webinar ↓ databricks.com/resources/webi…

Unity Catalog continues to expand open lakehouse interoperability. External access to UC managed Delta tables is now in Beta, allowing engines like Apache Spark, Apache Flink, and DuckDB to create, read, and write managed tables with transactional safety and centralized governance. Credential vending is also now GA, adding M2M OAuth support and automatic credential refresh so external engines can securely access UC-governed data without long-lived static credentials. databricks.com/blog/expanded-…

"We don't really need AI to get smarter. What we need is for it to have context." Databricks co-founder and CEO @alighodsi joined @CarolineHydeTV and @EdLudlow at the Bloomberg Tech event in San Francisco to make case that the real breakthrough will come not from smarter models but from giving AI the data context it needs to perform. That is the problem Databricks Genie is built to solve. Watch the full interview: youtube.com/watch?v=CipJDv…

Most agentic search systems get better by thinking longer: more tool calls, more reason-act loops, each step waiting on the last. Quality goes up, but so does latency. Instructed-Retriever-1 takes a different route. Instead of scaling test-time compute sequentially, it scales it in parallel. One retrieval-specialized model fans the work out: it generates multiple query and filter formulations to widen recall, then reranks the merged evidence with a multi-pivot reranker to sharpen precision. Both stages run at once, so searching more broadly no longer means searching more slowly. The result inside Knowledge Assistant: search time drops more than 3x and answer time 2x, with time to first token around two seconds, and no drop in quality (it matches Claude Sonnet 4.5 retrieval quality on KARLBench). For the people using it, that means far less waiting between question and answer, the freedom to ask more follow-ups, and more of the knowledge base actually surfaced. Rolling out to all customers now, with no reconfiguration. Read how we did it: databricks.com/blog/3x-faster…

[DEMO] Bring Genie to where your teams already work 🧞 Genie can now connect directly with Microsoft Teams, M365 Copilot, and SharePoint through a native integration with Copilot Studio. Users can ask questions of their data in natural language and get insights without leaving their workflow. Learn how to connect Databricks → add Genie to an agent → and publish it so teams can access answers in the tools they already use. youtu.be/2zLzCptIr9A

Introducing the lab sponsors for the Databricks Grounded Reasoning Cup at #DataAISummit 2026: @AnthropicAI, @OpenAI, and @GoogleDeepMind. Each lab is partnering with leading academic teams to build agents that tackle grounded reasoning over complex government data using the latest models and tooling. Meet the teams, see the agents they’re bringing to the competition, and join us as they push the boundaries of enterprise AI reasoning live on stage! 🏆

keyboard_arrow_left Previous keyboard_arrow_right Next

🆕 We’ve been busy shipping new features, and Nick Karpov and Holly Smith are here to break down the highlights in the latest episode of Over Architected. Covered in this episode: • Multi-table transactions • Lakeflow Designer • AI functions for RAG workflows • Vector search improvements • AI governance updates • New agent capabilities across the platform Watch the full walkthrough of what’s new ↓ youtube.com/watch?v=rPephv…

Join #DataAISummit virtually from anywhere in the world on June 16–17 🌎 The free virtual experience includes: • Full keynotes and select sessions • Exclusive online trainings • Expert commentary during Summit Live • On-demand access after the event Register now ↓ databricks.com/dataaisummit/v…

keyboard_arrow_left Previous keyboard_arrow_right Next

@NatalieFratto This is awesome 🫡

Apache Spark unlocked a new era of large-scale data processing. Now serverless compute is making it even easier to run those workloads with greater stability, predictability, and efficiency. We designed serverless compute by: → Separating applications from compute → Intelligently routing workloads → Dynamically scaling resources A closer look at the distributed systems architecture powering serverless Spark on Databricks: databricks.com/blog/rethinkin…

Partitioning has been the standard data layout approach for years, but modern lakehouse workloads need something more flexible. We’re debunking eight common myths that continue to keep teams tied to partitioning, and exploring why more organizations are moving to Liquid Clustering for better performance, storage efficiency, and data freshness at scale. Customers running Liquid Clustering at petabyte scale have reported: • Faster queries • Higher write throughput • Fewer small-file problems • More efficient storage and fresher data Learn more: databricks.com/blog/debunking…

Lakebase Customer-Managed Keys (CMK) gives organizations more control over how Postgres workloads are secured across both storage and compute layers. With support for AWS KMS, Azure Key Vault, and Google Cloud KMS, teams can manage their own root of trust, rotate keys seamlessly, and use key revocation to make data cryptographically inaccessible while terminating active compute instances for high-compliance environments. Learn more: databricks.com/blog/take-cont…

Enterprise data agents face a very different challenge than coding agents. They must reason across constantly changing tables, dashboards, notebooks, and documents without a clear source of truth or deterministic tests. This deep dive from the Databricks AI Research team explains how Genie uses specialized knowledge search, parallel thinking, and Multi-LLM orchestration to improve accuracy on real-world enterprise data analysis tasks from 32% to over 90%. databricks.com/blog/pushing-f…

Can’t make it to San Francisco for #DataAISummit? Join the virtual experience from anywhere! Stream the keynotes, watch select sessions, access exclusive online training, and follow expert commentary during Summit Live as major announcements happen in real time. Register now and tune in from wherever you are 🌎 databricks.com/dataaisummit/v…

Your Data + AI Summit journey awaits! Attend sessions across all 10 tracks, level up with hands-on trainings, earn a certification, and join the Hackathon alongside thousands of data and AI practitioners. Complete the full mission list and you might just leave as a Data + AI Summit champion. Start planning your journey and we’ll see you in San Francisco 🏆. databricks.com/dataaisummit?u…

.@MazdaUSA built a GenAI assistant on Databricks to help service hotline agents navigate growing diagnostic complexity with faster, more consistent support. The team brought together vehicle history, recalls, diagnostic data, and service documents into a single governed platform, while building repeatable GenAI evaluations and shared retrieval logic across both the application UI and the agent itself. See how Mazda built a repeatable foundation for future GenAI applications on governed enterprise data ↓ databricks.com/blog/legacy-la…

The Redpoint InfraRed 100 is now live. These are the companies building the infrastructure that powers everything happening in AI right now, from world models and agent runtimes to the sandboxes, databases, and security tools agents depend on. Congratulations to this year's honorees! Read the full 2026 InfraRed Report: our state of the union on AI and cloud infrastructure 👉 redpoint.com/reports/the-in…

Big news: Neon is expanding to offer a more complete set of backend primitives for running apps and agents: ✅ Database ✅ Authentication 🔜 Storage 🔜 Compute 🔜 AI Gateway

#DataAISummit is where the biggest conversations in data and AI happen. Hear from the biggest names in AI sharing what they’re building, deploying, and learning in real time. Join us in San Francisco or virtually and hear directly from the teams pushing the industry forward. databricks.com/dataaisummit?u…

keyboard_arrow_left Previous keyboard_arrow_right Next