Mid Databricks Data Engineer
New
I
ITELENCEData Engineering
Kraków, Wrocław, Warszawa, Poznań, PLContractMiddle
Salary23,520 - 28,560 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English B2
- Required Skills
- PythonSQLETLGitCI/CDDatabricks
Requirements
- Experience in a Data Engineer role or similar.
- Practical knowledge of Databricks.
- Proficiency in Python and/or SQL.
- Experience building ETL/ELT processes and data pipelines.
- Experience working with large datasets.
- Knowledge of fundamental Data Lake / Lakehouse concepts.
- Experience working with cloud platforms (Azure, AWS, or GCP).
- Ability to analyze and optimize data processing workflows.
- Good proficiency in English (B2 level).
- Ability to work independently in a project environment.
- Experience with Apache Spark / PySpark (nice to have).
- Knowledge of Azure Databricks (nice to have).
- Experience with Delta Lake (nice to have).
- Knowledge of CI/CD tools and Git (nice to have).
Responsibilities
- Design, build, and develop data engineering solutions in the Databricks environment.
- Create and develop ETL/ELT processes and data pipelines.
- Work with large datasets, transforming and preparing them for further analysis.
- Develop and optimize data processing workflows.
- Manage notebooks, jobs, and workflows within Databricks.
- Integrate data from various sources while ensuring data quality and consistency.
- Collaborate with Data Engineers, Data Scientists, and other technical teams.
- Monitor and optimize the performance of data processes.
- Document created solutions and processes.
View Full Description & ApplyYou'll be redirected to the employer's site
