- Design and implement the UniForm write layer for Delta and Iceberg metadata.
- Build GCS to BigQuery ingestion pipelines for structured operational datasets.
- Develop and implement robust data solutions using Python and Spark.
- Implement Kafka-based CDC patterns for real-time and near-real-time ingestion.
- Develop data lineage, dependency tracking, and modular adapter code.
- Configure Snowflake Horizon external tables for zero-copy reads.
- Implement and certify Delta Sharing endpoints for Databricks consumers.
- Build governed access layer components including RBAC and connector registry entries.
PythonGCPKafka+4 more