Data Eng Articles

Databricks announces General Availability of Real-Time Mode (RTM) for Apache Spark Structured Streaming, enabling millisecond-level latency without leaving the Spark ecosystem.

Announcements

Data Engineering

Customers

Databricks

31 min read

Data Engineering•2026-03-18

What’s New in Azure Databricks at FabCon 2026: Lakebase, Lakeflow, and Genie

This post covers new Azure Databricks capabilities announced at FabCon 2026, including Lakebase, Lakeflow Connect Free Tier, and Genie enhancements.

Data Engineering•2026-03-18

How to move from Apache Airflow® to Databricks Lakeflow Jobs

This post provides a practical migration guide for teams moving from Apache Airflow to Databricks Lakeflow Jobs as their native orchestrator.

Product

Databricks

41 min read

Data Engineering•2026-03-16

Talking to the Ground

This post shows how Databricks unifies siloed drilling data to deliver conversational AI analytics for oil and gas operations.

Data Engineering•2026-03-16

How Delta Sharing Supports ABAC Sharing for Providers and Recipients

Delta Sharing now supports Attribute-Based Access Control (ABAC), allowing providers to share governed tables directly without creating separate copies per recipient.

Data Engineering•2026-03-16

GCI Drives Value for Their Customers and Their Business with Databricks

GCI, Alaska's largest communications provider, details how its partnership with Databricks modernized data operations across a massive statewide network.

Databricks

51 min read

Data Engineering•2026-03-16

Develop and deploy Serverless JARs

Databricks introduces Serverless JARs, enabling teams to run Scala and Java Spark jobs on fully managed serverless compute with instant startup and no cluster management.

Data Engineering•2026-03-16

BigQuery Studio is more useful than ever, with enhanced Gemini assistant

BigQuery Studio's enhanced Gemini-powered assistant transforms from a code helper into a fully context-aware analytics partner.

Data Engineering•2026-03-16

Breaking the Microbatch Barrier: The Architecture of Apache Spark Real-Time Mode

Apache Spark 4.1 introduces Real-Time Mode (RTM) for Structured Streaming, enabling millisecond-level latency without abandoning the microbatch architecture.

Data Engineering

Databricks

31 min read

Data Engineering•2026-03-13

Serverless Workspaces in Azure Databricks is now Generally Available

Azure Databricks Serverless Workspaces are now generally available on Azure, enabling teams to create fully managed workspaces without any infrastructure setup.

Platform

Partners