Senior Data Engineer
New
D
DataArtData Engineering
Wrocław, plac Grunwaldzki 23, Warszawa, Prosta 20, Lublin, Tomasza Zana 39a, Kraków, Jana Dekerta 24, Łódź, Gdańska 130, Wrocław, Country code: PLFull-TimeSenior
Salary20,000 - 26,000 PLN per month
Apply NowOpens the employer's application page
Job Details
- Languages
- En B2
- Experience
- 5+ years
- Required Skills
- AWSPythonSQLApache AirflowSnowflakeAzureSparkdbtDatabricks
Requirements
- 5+ years of experience or 5+ completed projects.
- Advanced SQL and query optimization proficiency.
- Python for data engineering and automation.
- Experience with cloud data platforms: Snowflake and/or Databricks.
- Experience with cloud services: AWS and/or Azure.
- Data transformation and modeling experience using DBT.
- ETL/ELT pipeline design, development, and maintenance experience.
- Proficiency in Apache Spark (PySpark preferred).
- Workflow orchestration experience (e.g., Apache Airflow, Dagster).
- Strong relational database design and performance tuning skills.
- Solid understanding of data warehousing concepts and dimensional modeling.
- Proficiency in version control using Git and CI/CD practices.
Responsibilities
- Develop, operate, optimize, test, and maintain the data warehouse, including ETL/ELT process development, cube development, and dimensional table design.
- Drive the full life-cycle of back-end development for the data warehouse.
- Identify, design, and implement internal process improvements, such as infrastructure redesign for scalability, optimizing data delivery, and automating manual processes.
- Define data retention policies and implement automated processes for database updates and vulnerability corrections.
- Build analytical tools that leverage the data pipeline to deliver actionable insight into key business metrics.
- Select and integrate tools for monitoring, managing, alerting on, and improving database performance.
- Assemble large, complex datasets that meet functional and non-functional business requirements.
View Full Description & ApplyYou'll be redirected to the employer's site
