How we built Cloudflare's data platform and an AI agent on top of it

Cloudflare built Town Lake, a unified data analytics platform, and Skipper, an AI agent, to solve data sprawl across multiple systems.

• •Apache Trino query engine enables single SQL queries across Postgres, ClickHouse, and Iceberg on R2 without materializing intermediate results
• •R2 Data Catalog with Iceberg provides automatic data compaction as it ages, converting per-minute data to hourly and daily aggregates to reduce costs
• •Default-closed governance requires table approval before access, with automated PII detection using Workers AI to classify sensitive columns
• •Skipper AI agent allows natural language queries and suggests appropriate RBAC groups for access requests
• •Entire platform built on Cloudflare's own infrastructure: R2 for storage, Workers for compute, Workflows for orchestration