Senior Data Engineer
New
Warszawa, Łucka 15, Warszawa, Country code: PLContractSenior
Salary140 - 160 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English B2+
- Required Skills
- AWSSQLApache AirflowGCPJenkinsCI/CDTerraformBigQueryDatabricksPySpark
Requirements
- Senior-level experience in Data Engineering
- Strong hands-on experience with AWS CDK, AWS Lambda, Databricks, Google Cloud Platform (GCP), Google App Engine, BigQuery, and Dataproc
- Deep expertise in Apache Airflow and Terraform
- Very good knowledge of PySpark and SQL
- Practical experience in Data Quality initiatives
- Proven experience in Unit Testing and Integration Testing
- Proficiency with CI/CD tools such as GitHub Actions and Jenkins
- Experience working in distributed and international teams
- English proficiency at B2+ level or higher
Responsibilities
- Design, develop, and maintain cloud-based data engineering solutions
- Build, optimize, and support ETL/ELT data pipelines
- Process and manage large-scale datasets with a strong focus on Data Quality
- Develop solutions using PySpark and SQL
- Create and maintain unit and integration tests
- Automate deployment and delivery processes using CI/CD practices
- Collaborate closely with technical and business stakeholders
- Ensure continuity of ongoing initiatives by taking over responsibilities from a key client-side engineer
View Full Description & ApplyYou'll be redirected to the employer's site
