Data Engineer (Databricks, Azure)
New
A
Avanade PolandData engineering
Remote (within Poland)ContractSenior
Salary20,160 - 30,240 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English (at least B2); Polish B2
- Required Skills
- PythonSQLETLAzureTerraformData modelingDatabricksPySpark
Requirements
- Have commercial experience with Databricks.
- Have experience with Azure cloud and services, such as Azure Data Factory, Data Lake, SQL Database, and Azure Databricks.
- Have experience with Python and PySpark.
- Have experience with SQL.
- Know data engineering concepts including ETL, data modeling, medallion architecture, data warehousing, and data governance.
- Have experience with Terraform.
- Have English proficiency of at least B2.
- Docker and Kubernetes knowledge is a plus.
- Knowledge of OCR and related libraries, such as easyOCR, is a plus.
- Data science experience is a plus.
Responsibilities
- Design, build, and maintain scalable, efficient, and reliable data pipelines.
- Develop data architectures and end-to-end ETL processes.
- Collaborate with data scientists, analysts, and engineering teams on data integration and optimization.
- Apply engineering best practices across data solutions.
- Optimize data workflows and ensure data systems are reliable and performant.
- Take on a Team Lead role within a project when needed at Senior level.
- Develop skills in AI Engineering and explore opportunities in this area.
View Full Description & ApplyYou'll be redirected to the employer's site
