Senior Data Engineer / Databricks Developer
New
Warsaw, Centrum, Warsaw, Country code: PLContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English (B1)
- Required Skills
- PythonSQLETLSparkDatabricks
Requirements
- Strong hands-on experience with Databricks.
- Proficiency with Spark, SQL, Delta Lake, and Python.
- Experience designing and implementing data pipelines/ETL-ELT.
- Experience with data quality frameworks, preferably DQX.
- Understanding of data governance, data ownership, and rule-based data quality monitoring.
- Ability to translate business requirements into scalable technical solutions.
- Experience working in complex enterprise environments.
- English language proficiency (B1).
Responsibilities
- Design and implement a Databricks-native Data Quality Monitoring framework (DQX).
- Configure and implement DQX-based data quality rules.
- Develop data pipelines and data models supporting monitoring and reporting.
- Create dashboards and trending views for business users and data owners.
- Establish linkages between data quality rules, data usage, and critical data points.
- Document technical design, rule logic, and operating model.
- Support scaling the solution to additional clinical data domains.
View Full Description & ApplyYou'll be redirected to the employer's site
