Principal Data Engineer
S
Simple MachinesData engineering
Workable workplace: remote; Workable locations: Poland; Location: PolandFull-TimePrincipal
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLGCPSnowflakeSparkCI/CDTerraformDatabricks
Requirements
- Bring strong Python and SQL skills.
- Have deep experience with Spark and modern data platforms such as Databricks or Snowflake.
- Have a solid grasp of AWS or GCP cloud data services.
- Demonstrate ownership of large-scale data platform architectures.
- Bring strong data modelling skills and architectural decision-making ability.
- Have built and operated large-scale data pipelines in production.
- Have experience with infrastructure as code using Terraform or Pulumi.
- Have experience with CI/CD pipelines using tools such as GitHub Actions or ArgoCD.
- Have experience with data testing and quality frameworks such as dbt, Great Expectations, or Soda.
- Have experience in consulting or professional services environments.
- Be comfortable mentoring senior engineers and influencing technical culture.
Responsibilities
- Own the end-to-end architecture of modern, cloud-native data platforms.
- Design and deliver platforms using Databricks, Snowflake, AWS, and GCP.
- Build and optimize batch and real-time data pipelines.
- Work with streaming and event-driven technologies including Kafka, Flink, Kinesis, and Pub/Sub.
- Orchestrate workflows using Airflow, Dataflow, and Glue.
- Process and transform large datasets using Spark and Flink.
- Optimize storage formats and access patterns across relational, NoSQL, and analytical stores.
- Work directly with clients to understand problems and shape solutions.
- Set engineering standards, review designs and code, and mentor engineers.
View Full Description & ApplyYou'll be redirected to the employer's site