DataBricks Engineer

8+ years of experience as a data engineer or in related roles Minimum 2-3 years of experience with DataBricks platform (clusters, workspaces, security, migrations, ETL, integrations) Strong knowledge of Apache Spark (PySpark, query optimization) Proficiency in Python for data engineering (designing and implementing ETL/ELT pipelines) Practical experience with Delta Lake and data governance concepts (Unity Catalog or similar) Practical experience with Delta Live Tables (DLT) or similar tools Experience working in Microsoft Azure (Data Factory, Synapse, Logic Apps, Data Lake) and/or AWS (Redshift, Athena, Glue) Proficiency in SQL for schema design, query optimization, and business logic implementation Ability to take initiative and work independently English language proficiency for effective team communication

Design, implement, and maintain scalable Data Lakehouse solutions (Databricks, Delta Lake, Medallion Architecture) Create and optimize advanced ETL/ELT pipelines using PySpark and Delta Live Tables (DLT) Participate in platform migration projects and refactor legacy business logic (SSIS, Boomi) Implement data governance and security mechanisms (Unity Catalog, RBAC, IaC) Monitor, tune performance, and automate data engineering processes to meet critical SLAs Collaborate with Data Scientists, Data Engineers, and Architects as a technical expert