Senior Data Engineer - Freelance
New
N
NetguruDigital commerce
European UnionContractSenior
Salary30 - 50 EUR per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English (C1+)
- Experience
- 4+ years
- Required Skills
- AWSPythonBashSparkScala
Requirements
- 4+ years of commercial experience as a Data Engineer.
- Deep expertise in the AWS tech stack, specifically Glue, DMS, Redshift, and S3.
- Strong proficiency in Python, Scala, and Bash.
- Experience building crash-resistant and idempotent pipelines.
- Knowledge of Spark job optimization (partitioning, Parquet, broadcast joins).
- Excellent command of written and spoken English (C1+).
- Strong attention to detail and creative problem-solving skills.
Responsibilities
- Manage end-to-end data lifecycles within the AWS environment.
- Develop production data transformations and CDC processes using Scala.
- Maintain CI/CD operations and pipelines using Bash.
- Build crash-resistant and idempotent data pipelines.
- Optimize Spark jobs through effective partitioning, columnar formats like Parquet, and broadcast joins.
View Full Description & ApplyYou'll be redirected to the employer's site
