Senior Data Engineer – Google Cloud
New
O
Ontrac SolutionsCloud data consulting
United States or Canada, fully remote.ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years in data engineering, including 3+ years delivering production workloads on Google Cloud Platform
- Required Skills
- PythonSQLGCPSparkBigQuery
Requirements
- Have 6+ years of data engineering experience, including 3+ years delivering production workloads on Google Cloud Platform.
- Bring hands-on BigQuery experience in data modeling, partitioning, clustering, cost and performance tuning, and ELT in SQL.
- Have built and operated batch and streaming pipelines with Dataflow (Apache Beam) and/or Dataproc (Spark / PySpark), with Pub/Sub as a streaming source.
- Have orchestrated production workflows with Cloud Composer (Apache Airflow), including dependency management, retries, and alerting.
- Have strong Python and advanced SQL skills.
- Have provisioned GCP data infrastructure with Terraform and deployed through Git-based CI/CD.
- Have completed at least one migration into BigQuery from an on-premises or legacy platform, including data validation and cut-over.
- Have client-facing experience running requirements sessions, presenting designs, and handing off documented solutions to customer teams.
Responsibilities
- Assess the customer's current data estate and produce a target-state GCP data architecture and migration plan.
- Build batch and streaming ingestion, transformation, and orchestration pipelines into BigQuery.
- Deploy data infrastructure and pipelines through Terraform and CI/CD.
- Migrate historical data and workloads, documenting reconciliation for row- and aggregate-level parity.
- Tune BigQuery models and queries for cost and performance.
- Provide monitoring and alerting for pipeline health.
- Deliver runbooks and architecture documentation.
- Conduct knowledge-transfer sessions so customer teams can own the platform after hand-off.
View Full Description & ApplyYou'll be redirected to the employer's site