Senior Data Engineer - Data Platform
New
J
JobgetherData engineering
IndiaContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent German and English communication skills.
- Experience
- At least 5 years of professional experience in data engineering.
- Required Skills
- PythonSQLGitMicrosoft AzureSparkCI/CDDatabricksPySpark
Requirements
- Have at least 5 years of professional experience in data engineering.
- Bring strong hands-on experience with Databricks, SQL, Python, Apache Spark, and PySpark.
- Have experience designing, developing, and operating scalable data pipelines.
- Have advanced knowledge of dbt Core, particularly in Databricks environments.
- Have experience with data modeling based on Data Vault 2.0.
- Have experience with historical data models, dimensional modeling, data quality testing, and data documentation.
- Know Git, CI/CD pipelines, and automated testing practices.
- Have practical experience operating data solutions in Microsoft Azure.
- Have several years of experience working in a corporate environment.
- Have experience with agile methodologies; SAFe knowledge is an advantage.
- Communicate fluently in German and English.
- Bring strong analytical and problem-solving skills and the ability to resolve complex technical issues independently.
- Work independently, in a structured and goal-oriented manner, and adapt to a dynamic environment.
Responsibilities
- Further develop, maintain, and operate a modern data platform built on Databricks.
- Design, develop, optimize, and maintain scalable data pipelines and data products.
- Implement data models following Data Vault 2.0 principles.
- Develop and manage data transformations using dbt Core on Databricks.
- Establish and maintain data quality, testing, and validation processes.
- Ensure stable, high-performance, and cost-efficient operation of data solutions in Microsoft Azure.
- Work with historical data models, dimensional modeling, and data documentation.
- Collaborate with agile project and product teams and stakeholders to deliver data engineering solutions.
- Support automation of development, testing, and deployment workflows using CI/CD pipelines.
- Apply version control, automated testing, and continuous integration practices.
View Full Description & ApplyYou'll be redirected to the employer's site