How we built Cloudflare's data platform and an AI agent on top of it
Quick Answer
Cloudflare developed Town Lake, a unified data analytics platform, and Skipper, an AI agent, enabling seamless access to data across multiple systems.
Quick Take
This architecture supports over a billion events per second and provides accurate, auditable answers in plain English, addressing previous data sprawl and accessibility issues.
Key Points
- Town Lake integrates various data sources into a single SQL interface.
- Skipper allows users to query data in plain English, enhancing accessibility.
- The platform processes over a billion events per second efficiently.
- Data governance features include automatic PII detection and time-bounded permissions.
- Apache Trino powers the query engine, enabling complex joins across different data types.
Source Excerpt
Here’s how we built Town Lake, Cloudflare's unified analytics platform, alongside Skipper, an internal AI agent running on top of it.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from Cloudflare AI
See more →
Temporary Cloudflare Accounts for AI agents
Cloudflare introduces Temporary Accounts on Cloudflare Workers, enabling AI agents to deploy live Workers instantly using 'wrangler deploy --temporary'. This feature removes barriers for AI agents, allowing them to operate more efficiently in real-time environments.
