Senior Data Engineer (Databricks)
New
R
RemoDevsFinancial services
Locations: Gdynia, x, Szczecin, x, Gdynia, Country code: plContractSenior
Salary24,000 - 29,000 PLN per month
Apply NowOpens the employer's application page
Job Details
- Languages
- English proficiency at C1 level.
- Experience
- 5+ years of commercial experience in Data Engineering. Minimum 3 years of hands-on experience with Databricks.
- Required Skills
- PythonSQLSparkData modelingDatabricksPySpark
Requirements
- Have 5+ years of commercial experience in Data Engineering.
- Have a minimum of 3 years of hands-on experience with Databricks.
- Have strong practical knowledge of Apache Spark and PySpark.
- Have advanced SQL and Python programming skills.
- Have experience designing and implementing ETL/ELT pipelines.
- Understand Delta Lake and Lakehouse architecture.
- Know data modeling, data warehousing, and data integration.
- Have experience optimizing data processing performance and managing large datasets.
- Have English proficiency at C1 level.
- Banking or financial services experience is a plus.
- Azure Data Factory, CI/CD pipelines, Infrastructure as Code, Databricks certifications, and knowledge of financial data governance and regulatory requirements are nice to have.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build and optimize ETL/ELT processes for large-scale data processing.
- Develop data transformation solutions using PySpark, Python, and SQL.
- Implement and optimize Delta Lake architectures.
- Design and maintain reliable data ingestion and integration processes.
- Improve data quality, performance, and reliability across data platforms.
- Collaborate with Data Architects, Analysts, and business stakeholders to deliver data solutions.
- Ensure data security, governance, and compliance with financial industry standards.
- Troubleshoot and optimize existing data engineering workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
