Senior Data Engineer (Databricks, Azure)
New
A
Avanade PolandData engineering
Remote (within Poland)ContractSenior
Salary120 - 180 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English (at least B2); Polish B2
- Required Skills
- PythonSQLETLAzureTerraformData modelingDatabricksPySpark
Requirements
- Have commercial experience with Databricks.
- Have commercial experience with Azure cloud and services, such as Azure Data Factory, Data Lake, SQL Database, or Azure Databricks.
- Have commercial experience with Python and PySpark.
- Have commercial experience with SQL.
- Know data engineering concepts including ETL, data modeling, medallion architecture, data warehousing, and data governance.
- Have commercial experience with Terraform.
- Have English proficiency of at least B2.
- Docker and Kubernetes knowledge is a plus.
- Knowledge of OCR and related libraries such as easyOCR is a plus.
- Experience in data science is a plus.
Responsibilities
- Design, build, and maintain scalable, efficient, and reliable data pipelines.
- Develop data architectures and ETL processes end to end.
- Collaborate with data scientists, analysts, and engineering teams on data integration and optimization.
- Apply engineering best practices across data solutions.
- Optimize data workflows and ensure data-system reliability and performance.
- Take on a Team Lead role within a project when needed.
- Develop skills in AI Engineering and explore opportunities in this area.
View Full Description & ApplyYou'll be redirected to the employer's site