Data Engineer (Airflow / Snowflake)
New
E
emagine PolskaData engineering
Locations: Warsaw, Centrum, Warsaw, Country code: PL; Location: 100% remoteContractMiddle
SalaryUp to 160 pln/h net + VAT, B2B
Apply NowOpens the employer's application page
Job Details
- Languages
- English at B2 level or higher.
- Experience
- 3+ years of experience as a Data Engineer.
- Required Skills
- PythonSQLApache AirflowGitSnowflakeData engineeringCI/CDdbt
Requirements
- Have 3+ years of experience as a Data Engineer.
- Have strong knowledge of Apache Airflow operators, sensors, hooks, TaskFlow API, XCom, pools, backfills, and idempotent DAG design.
- Write clean, testable Python code and use pytest.
- Have advanced SQL skills, including window functions, CTEs, and query optimization.
- Have hands-on Snowflake experience with warehouses, stages, external volumes, and COPY INTO.
- Work with dbt models, tests, macros, snapshots, and incremental models.
- Understand AWS S3 Data Lake organization, partitioning, Parquet, JSON, CSV, and IAM policies.
- Have Git and CI/CD experience.
- Have English proficiency at B2 level or higher.
Responsibilities
- Design, build, and maintain Apache Airflow DAGs in Python that load data into the Data Lake (S3) and Snowflake.
- Build pipelines to ingest data from APIs, databases, and files.
- Model and transform data with dbt.
- Tune SQL queries and Snowflake performance and cost.
- Set up monitoring, alerting, and error handling for pipelines.
- Protect data quality through testing and validation, and keep documentation current.
View Full Description & ApplyYou'll be redirected to the employer's site