Principal Data Engineer

S
Simple MachinesData engineering
Workable workplace: remote; Workable locations: Poland; Location: PolandFull-TimePrincipal
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Required Skills
AWSPythonSQLGCPSnowflakeSparkCI/CDTerraformDatabricks

Requirements

  • Bring strong Python and SQL skills.
  • Have deep experience with Spark and modern data platforms such as Databricks or Snowflake.
  • Have a solid grasp of AWS or GCP cloud data services.
  • Demonstrate ownership of large-scale data platform architectures.
  • Bring strong data modelling skills and architectural decision-making ability.
  • Have built and operated large-scale data pipelines in production.
  • Have experience with infrastructure as code using Terraform or Pulumi.
  • Have experience with CI/CD pipelines using tools such as GitHub Actions or ArgoCD.
  • Have experience with data testing and quality frameworks such as dbt, Great Expectations, or Soda.
  • Have experience in consulting or professional services environments.
  • Be comfortable mentoring senior engineers and influencing technical culture.

Responsibilities

  • Own the end-to-end architecture of modern, cloud-native data platforms.
  • Design and deliver platforms using Databricks, Snowflake, AWS, and GCP.
  • Build and optimize batch and real-time data pipelines.
  • Work with streaming and event-driven technologies including Kafka, Flink, Kinesis, and Pub/Sub.
  • Orchestrate workflows using Airflow, Dataflow, and Glue.
  • Process and transform large datasets using Spark and Flink.
  • Optimize storage formats and access patterns across relational, NoSQL, and analytical stores.
  • Work directly with clients to understand problems and shape solutions.
  • Set engineering standards, review designs and code, and mentor engineers.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now