Senior Data Engineer – Google Cloud

New
O
Ontrac SolutionsCloud data consulting
United States or Canada, fully remote.ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
6+ years in data engineering, including 3+ years delivering production workloads on Google Cloud Platform
Required Skills
PythonSQLGCPSparkBigQuery

Requirements

  • Have 6+ years of data engineering experience, including 3+ years delivering production workloads on Google Cloud Platform.
  • Bring hands-on BigQuery experience in data modeling, partitioning, clustering, cost and performance tuning, and ELT in SQL.
  • Have built and operated batch and streaming pipelines with Dataflow (Apache Beam) and/or Dataproc (Spark / PySpark), with Pub/Sub as a streaming source.
  • Have orchestrated production workflows with Cloud Composer (Apache Airflow), including dependency management, retries, and alerting.
  • Have strong Python and advanced SQL skills.
  • Have provisioned GCP data infrastructure with Terraform and deployed through Git-based CI/CD.
  • Have completed at least one migration into BigQuery from an on-premises or legacy platform, including data validation and cut-over.
  • Have client-facing experience running requirements sessions, presenting designs, and handing off documented solutions to customer teams.

Responsibilities

  • Assess the customer's current data estate and produce a target-state GCP data architecture and migration plan.
  • Build batch and streaming ingestion, transformation, and orchestration pipelines into BigQuery.
  • Deploy data infrastructure and pipelines through Terraform and CI/CD.
  • Migrate historical data and workloads, documenting reconciliation for row- and aggregate-level parity.
  • Tune BigQuery models and queries for cost and performance.
  • Provide monitoring and alerting for pipeline health.
  • Deliver runbooks and architecture documentation.
  • Conduct knowledge-transfer sessions so customer teams can own the platform after hand-off.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now