Senior Data Engineer
New
N
NetguruDigital Commerce
PolandContractSenior
Salary27 - 37 EUR per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English (C1+)
- Experience
- 4+ years
- Required Skills
- AWSPythonBashSparkScalaRedshift
Requirements
- 4+ years of commercial working experience as a Data Engineer.
- Deep expertise in AWS tech stack including Glue, DMS, Redshift, and S3.
- Strong proficiency in Python, Scala, and Bash.
- Experience in building crash-resistant and idempotent pipelines.
- Ability to optimize Spark jobs via partitioning, columnar formats (Parquet), and broadcast joins.
- Excellent command of written and spoken English (C1+).
- Attention to detail and strong creative problem-solving abilities.
Responsibilities
- Manage end-to-end data lifecycles across the AWS ecosystem.
- Build and maintain crash-resistant, idempotent data pipelines.
- Perform data transformations and CDC using Scala in production environments.
- Optimize Spark jobs using partitioning, Parquet columnar formats, and broadcast joins.
- Implement CI/CD operations using Bash scripts.
- Collaborate with cross-functional teams on challenging, long-term software products.
View Full Description & ApplyYou'll be redirected to the employer's site
