Senior Data Engineer (AWS)
New
X
Xebia sp. z o.o.Data Engineering
Work from the European Union regionFull-TimeSenior
Salary21000 - 33000 PLN per month b2b
Apply NowOpens the employer's application page
Job Details
- Languages
- En B2
- Experience
- 5+ years
- Required Skills
- AWSPythonSQLGitAirflowCI/CDTerraformdbt
Requirements
- 5+ years of experience in Data Engineering.
- Strong Python development skills.
- Advanced SQL proficiency.
- Hands-on experience with AWS-based data platforms (Lake Formation, Athena, Glue, DynamoDB).
- Experience building and maintaining data pipelines in Apache Airflow.
- Commercial experience with dbt.
- Exposure to graph databases, preferably Amazon Neptune (Neo4j, CosmosDB).
- Solid knowledge of Git, CI/CD practices, and Terraform.
- Experience with Apache Iceberg in production environments.
- Knowledge of OpenLineage or similar lineage frameworks.
Responsibilities
- Design and implement scalable data pipelines ingesting data from DynamoDB, Aurora PostgreSQL, and Neptune.
- Build and maintain data lake layers (Raw, Canonical, Curated) on Amazon S3 using Apache Iceberg.
- Develop ingestion frameworks supporting CDC and batch processing patterns.
- Maintain the AWS Glue Data Catalog.
- Develop and maintain Airflow workflows for data pipeline orchestration.
- Implement CI/CD practices and automate testing, validation, and deployment processes.
- Optimize query performance, storage layouts, and Iceberg table design.
- Troubleshoot and resolve production issues to improve platform stability.
View Full Description & ApplyYou'll be redirected to the employer's site
