Sr. Data Engineer (Poland)

View full description

Requirements:

• 4+ years of experience in Data Engineering.
• 4+ years of experience with Python.
• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.
• Strong knowledge of SDLC and solid software engineering practices.
• Knowledge and experience with Amazon Web Services (AWS) and Databricks (nice to have).
• Familiar with infrastructure-as-code approach.
• Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.

Responsibilities:

• Building and optimizing data pipelines (batch and streaming).
• Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data
• Designing software that is easily testable and maintainable.
• Support in setting data strategies and our vision.
• Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.
• Work on extendable data processing systems that allows to add and scale pipelines.
• Applying machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets.