Platform Articles

Databricks

21 min read

Data Engineering•2026-03-12

The Evolution of Data Engineering: How Serverless Compute is Transforming Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines

This article covers how Databricks serverless compute is transforming data engineering by removing infrastructure management burdens across Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines.

Platform

Product

Platform Articles

Related Tags

How Addepar Scales Investment Workflows with Databricks AI Agents

How agentic software development will change databases

Protect Performance and Reduce Surprise Costs with Default Warehouse

Zero-Downtime Patching in Lakebase Part 1: Prewarming

Building an A/B testing analysis framework for mobile gaming on Databricks

Stop Hand-Coding Change Data Capture Pipelines

Databricks Announces Lakewatch: New Open, Agentic SIEM

Agentic AI Security: New Risks and Controls in the Databricks AI Security Framework (DASF v3.0)

What’s New in Azure Databricks at FabCon 2026: Lakebase, Lakeflow, and Genie

How Delta Sharing Supports ABAC Sharing for Providers and Recipients

Ship quality enterprise AI agents to business users with Agent Bricks and Databricks Apps

Develop and deploy Serverless JARs

Serverless Workspaces in Azure Databricks is now Generally Available

10 Data Warehouse Migration Myths Blocking AI-readiness (and Your Blueprint for Seamless Modernization)

The Evolution of Data Engineering: How Serverless Compute is Transforming Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines

Mitigating The Risk of Prompt Injection for AI Agents on Databricks

Introducing Genie Code

Databricks acquires Quotient AI to power AI agent evaluations

Beyond Provisioning: The Developer’s Guide to Databricks Lakebase Autoscaling

Bringing Visualizations to Life in Multi‑Agent Systems With Vega‑Lite