- Lead the design and evolution of the lakehouse, including storage layout, table formats, layering, partitioning, and retention.
- Model curated and semantic layers for analytics and reporting.
- Design batch, incremental, and CDC ingestion from source modules and establish data contracts.
- Build and operate ETL/ELT pipelines with dependency management, backfill strategies, and idempotent reprocessing.
- Build data quality tooling and platform observability, including lineage, SLAs, alerting, and cost telemetry.
- Own production health and incident response.
- Collaborate with engineering leads and product managers to align technical execution and consistency.
- Design backend services and APIs that expose curated datasets to product modules.
- Implement multi-tenant data isolation, authentication and authorization, and serving patterns such as query APIs, materialized views, and caching.
- Mentor developers and contribute to data engineering practices across squads.
PythonSQLSnowflake+5 more