Codelab: Build an Apache Iceberg Lakehouse on GCP without external catalogs
jggomezt · x · 2026-10-01
Developer jggomezt released a step-by-step codelab for building an Apache Iceberg lakehouse on GCP without external catalogs: Datastream CDC into GCS (Avro), Dataflow (Beam) to write Bronze & Silver Iceberg layers, and a Gold datamart natively in BigQuery. The stack emphasizes open formats, ACID guarantees, and zero vendor lock-in, with a full lab on GitHub.
More from coding & agent
- Agent autonomously checks in a flight 24 hours ahead — and pings only on failure — armand_ruiz · 2026-10-01
- 0.8B model plus 9 LoRA adapters routes agent decisions 38x faster with +8.7 accuracy — Usual_Maximum7673 · 2026-10-01
- Context engineering's next step: knowledge system engineering — ShanRizvi · 2026-10-01
- Codex's model picker now needs a scrollbar — should OpenAI add auto-routing? — darkprinceimmortal · 2026-10-01
- OpenAI's DevDay agent launches put startups on notice, says founder in the crosshairs — NoSpecific64 · 2026-10-01
- Dev adds Apple's Genie effect to AI agent plugin with Opus, says he's basically built an agentOS — RileyRalmuto · 2026-10-01