Lead Data Platform Engineer
New
C
co.brick TalentsData engineering
100% Zdalnie (wymagana lokalizacja specjalisty w Polsce)ContractLead
Salary180 - 215 PLN per hour net b2b
Apply NowOpens the employer's application page
Job Details
- Languages
- Polski (biegły) / Angielski (biegły)
- Required Skills
- AWSDockerPythonSQLSnowflakeAirflowTerraform
Requirements
- Demonstrate advanced Python engineering skills, including OOP and type hints.
- Have experience creating and publishing Python libraries and packages.
- Have experience maintaining large codebases.
- Have production experience with AWS and Snowflake.
- Have advanced SQL skills, including query optimization and working with large data volumes.
- Have solid knowledge of data warehousing, ETL pipelines, and data governance.
- Have practical experience with Terraform and Docker.
- Know CI/CD processes; GitLab CI is preferred.
- Know Airflow or Dagster.
- Have experience managing secrets with Vault, AWS Secrets Manager, or Parameter Store.
- Be fluent in Polish and English for daily communication.
Responsibilities
- Build and develop internal Python libraries, packages, and tools for the data platform.
- Design and develop the platform architecture using Snowflake and AWS.
- Define engineering standards for code quality, testing, code review, and architecture practices.
- Implement infrastructure as code with Terraform and build deployment pipelines using GitLab CI and Docker.
- Oversee ETL process orchestration with Airflow or Dagster.
- Establish data governance and security practices, including secrets management.
- Provide technical support to other engineers.
- Collaborate on technology decisions.
View Full Description & ApplyYou'll be redirected to the employer's site
