Senior Data Engineer
New
G
GS ServicesData engineering
100% zdalnie; Country code: PLContractSenior
Salary170 - 220 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- En B2
- Experience
- Minimum 7 years of experience in Data Engineering, ETL, and Data Warehouse development and modeling
- Required Skills
- AWSPythonSQLApache AirflowGitData engineeringData modelingdbt
Requirements
- Have at least 7 years of experience in Data Engineering, ETL, and Data Warehouse development and modeling.
- Have very good SQL skills, including data transformation and validation, reconciliation, troubleshooting, and query optimization.
- Have experience with dimensional data modeling, including Star Schema, Snowflake Schema, Fact and Dimension Modeling, and Slowly Changing Dimensions.
- Have practical Python experience in Data Engineering or workflow automation.
- Have experience with dbt.
- Have AWS experience, particularly S3, Glue, Lambda, and Redshift.
- Have Apache Airflow experience, including creating DAGs and orchestrating workflows.
- Have experience building and maintaining production ETL/ELT pipelines.
- Understand data quality, error handling, and production support.
- Have experience creating architecture diagrams and technical documentation.
- Know Git or similar version control tools.
Responsibilities
- Develop and maintain R&D data pipelines.
- Analyze source files, business requirements, mappings, and existing pipeline configurations.
- Create and maintain architecture diagrams and conceptual, logical, and physical data models.
- Design data models using Star Schema and Snowflake Schema.
- Build and optimize data transformations with dbt.
- Develop ingestion, transformation, and publishing logic using YAML, AWS S3, Airflow, SQL, and Redshift.
- Support Medallion architecture and implement data quality checks and exception handling.
- Handle schema changes, new columns, data types, missing fields, and file formats.
- Validate and reconcile source-to-target data before production deployment; troubleshoot production pipeline and data issues.
- Participate in code reviews, testing, deployments, documentation updates, and collaboration with business, vendors, and technical teams.
View Full Description & ApplyYou'll be redirected to the employer's site
