Senior Data Engineer (Databricks)
New
I
Intetics Inc.Software Development
Poland. Serbia. Romania. Spain. United Kingdom. EstoniaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of data engineering experience
- Required Skills
- AWSPostgreSQLPythonSQLETLAzureSparkDatabricksPySpark
Requirements
- 4+ years of data engineering experience.
- At least 2 years on Databricks or the Apache Spark ecosystem across Azure and/or AWS.
- Proficiency in PySpark, SQL, and Python.
- Hands-on experience with Delta Lake including schema evolution and ACID transactions.
- Experience with pipeline performance tuning and compute optimization in production Databricks environments.
- Solid working knowledge of PostgreSQL including query optimization and schema design.
- Experience supporting and maintaining legacy ETL tooling (SSIS, Informatica, custom Python/SQL pipelines).
- Experience supporting large-scale multi-tenant architectures with a focus on tenant isolation and data privacy.
- Strong understanding of data governance, security, and compliance principles.
- Proven ability to work collaboratively across Data Science, Product, and Infrastructure teams.
Responsibilities
- Own Databricks production support for the predictive data platform, including monitoring, alerting, and incident response.
- Maintain and report on SLA performance metrics for data pipeline delivery.
- Identify and implement pipeline optimizations that reduce Databricks compute costs and improve throughput.
- Migrate legacy ETL/ELT pipelines to Databricks and build automation tooling.
- Support new customer onboarding by provisioning, validating, and hardening tenant data pipelines.
- Design and build high-performance Databricks pipelines to process ERP and CRM data at scale.
- Enforce data security best practices including role-based access control and secrets management.
- Implement data quality monitoring and observability across pipeline health and ML model inputs.
View Full Description & ApplyYou'll be redirected to the employer's site
