We’re getting ready to pilot the Databricks Detective Series ahead of its launch at Data + AI Summit 2026, and we’re looking for Community members to help test it. Databricks Detective Series is a free, gamified, hands-on experience where you become...
We promised something special and here it is. We're thrilled to introduce the DAIS 2026 Community Virtual Challenge, open to every member of the Databricks Community, wherever you are in the world. Opens: May 15, 2026 Closes: May 31, 2026 Winners...
Calling all builders!Since GA, thousands of teams have moved production workloads onto Lakebase. We want to hear how you’re using it.A few examples of stories we’d love to capture: Building stateful AI agents that need persistent memory alongside lak...
Already registered for Data + AI Summit 2026? Join us on Monday, June 15 for the Databricks Apps & Agents for Good Hackathon 2026, hosted in partnership with OpenAI. Secure your spot and apply by Sunday May, 31 Note: Marking RSVP on this Community ...
DAIS 2026 · Speaker Spotlight A conversationwith Surya Sai Turaga On how Ensemble Health Partners turned 800TB of fragmented revenue cycle data into an AI-ready foundation on Databricks Lakebase — and the agentic-AI playbook for healthcare. ...
Limited seats are available to join our revamped training program at Data + AI Summit 2026 in San Francisco, with early-bird pricing that gives you 50% off training if you register by April 30. Key highlights Big savings on training and certification...
Our Community Champion Program celebrates members who consistently contribute their expertise, support fellow practitioners, and help shape a stronger and more collaborative Databricks Community. Every month, we recognize individuals whose passion fo...
In today’s media landscape, it can be difficult to know which marketing channels are driving results. The Media Mix Modeling (MMM) Solution Accelerator helps organizations bring together data from channels such as TV, social media and email marketing...
The Weekly Digest • May 11 – May 17 Community Pulse Catch up on the week's best discussions, articles, and announcements -- fast. Top Contributors This Week Contributors leading with curiosity and kindness: @KrisJohannesen @Sumit_7 @amirabe...
Databricks has a new/updated feature in Beta: Databricks Container Services for standard compute.Docs: https://docs.databricks.com/aws/en/compute/custom-containers-standardWith this feature, you can specify a Docker image when creating standard compu...
With Genie Code, you can now add a Tableau or Power BI file and have it build an AI/BI dashboard that replicates your existing visualizations - while connecting them to metric views that mirror the underlying business logic.Import BI files using Geni...
In standard Genie Space chat, space managers can use the Monitoring tab to review prompts/conversations. However, in Agent Mode, we see the warning:“Genie agent responses may contain results obtained using other users’ credentials and are hidden from...
Answers to your questions: Why Agent Mode is treated differentlyBecause Agent Mode can generate synthesized text/report answers from multi-step reasoning, and internal product guidance says those answers may contain data outside the reviewing manage...
You created a materialized view. You assumed it refreshed incrementally. Then, at 6 a.m., a refresh on a billion-row source ran a full recompute, and your monthly Databricks bill grew a leg. This is the surprise every team hits at least once. By defa...
Hi Databricks Community,For the DAIS 2026 Community Virtual Contest, I built a project called Grocery Data Intelligence. This is a Smart Grocery Planning solution with Data + AI, built using Databricks Free Edition.The idea came from a very simple re...
Hi Brahma,Really impressive work! The problem framing alone sets this apart — stockouts vs. waste as two sides of the same inventory problem is exactly the kind of clarity that makes a solution easy to champion internally at a store level.A few thing...
You likely maintain at least two separate copies of your crucial data. One resides in your data lake, serving as the source for pipeline writes, ML model training, and engineer debugging. The other is in a cloud data warehouse, which powers dashboard...
R1 is a leading provider of revenue management solutions for healthcare organizations, supporting hospitals, health systems, and physician groups across front-, middle-, and back-office revenue operations. Through its Phare Revenue Operating System, ...
Saving logs from an all-purpose cluster to Volume or S3 is not consistent, because stderr, stdout, and log4j-active.log get overwritten when the cluster is restarted between minutes 01 and 59.Tested case:A job is configured to start every 20 minutes,...
Hi @ccsalt , This is a known limitation. Log rotation (renaming to log4j-YYYY-MM-DD-HH.log.gz) only happens on the hour boundary. The active log file log4j-active.log has always the same name and is overwritten if a cluster restart happens within one...
I have a requirement where I need to run multiple concurrent runs on a particular table, however some merges fail and some merges execute. how can i handle thisI have a requirement where I need to run multiple concurrent runs on a particular table, h...
I have a requirement where I need to run multiple concurrent operations on a particular table. However, some merge operations fail while others succeed. How can I handle this?I have tried the following options:Partitioning by primary key – I performe...
Databases have powered software for decades, but their underlying architecture hasn’t kept pace with modern application needs—especially in the era of AI and rapid development. Lakebase introduces a new approach by separating compute from storage an...
There is a mandatory shift to Autoscaling part of the Lakebase evolution. More details here
The OLTP landscape within the Data Intelligence Platform is undergoing an essential evolutionary step. Databricks has announced an automatic upgrade path shifting all legacy Lake base Provisioned Instances to the modern elastic Lake base Autoscaling ...
Databricks has expanded Unity AI Gateway with new beta capabilities for service policies, LLM guardrails, payload logging, and cost controls, giving teams one place to govern model calls, agent actions, and MCP interactions as AI moves into productio...
Our data team kept hitting the same problem. We needed UIs for business users, dashboards, CRUD apps, internal tools. Streamlit was our go to but it reruns the entire script on every interaction, the interfaces all look identical, and it gets painfu...
Hi our team wants to import data from Databricks catalog tables to SQL server.Is it possible to do so using SSIS package on SQL server ? what settings are required on Databricks tables?Suggest me some ETL tools and how to do it using SSIS
Yes, it is possible to integrate SSIS packages with Delta tables using JDBC/ODBC connectivity.Required on Databricks side:SQL Warehouse or interactive clusterJDBC/ODBC driverHostname, HTTP Path, Port 443, and PAT tokenProper table permissions in Unit...
DAIS 2026 · Speaker Spotlight A conversationwith Surya Sai Turaga On how Ensemble Health Partners turned 800TB of fragmented revenue cycle data into an AI-ready foundation on Databricks Lakebase — and the agentic-AI playbook for healthcare. ...
| User | Count |
|---|---|
| 2265 | |
| 1315 | |
| 1208 | |
| 1193 | |
| 958 |
| User | Count |
|---|---|
| 432 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
You created a materialized view. You assumed it refreshed incrementally. Then, at 6 a.m., a refresh on a billion-row source ran a full recompute, and your monthly Databricks bill grew a leg. This is t...
You likely maintain at least two separate copies of your crucial data. One resides in your data lake, serving as the source for pipeline writes, ML model training, and engineer debugging. The other is...
R1 is a leading provider of revenue management solutions for healthcare organizations, supporting hospitals, health systems, and physician groups across front-, middle-, and back-office revenue operat...
Your preferred AI model is a deeply personal choice. Public benchmarks might declare the “best” model for a specific task, but they don’t account for your workflow or how you access information, which...
