Senior Data Engineer (DataBricks)

Posted about 7 hours agoViewed

View full description

💎 Seniority level: Senior, 4+ years

📍 Location: Lithuania

💸 Salary: 4000.0 - 6000.0 EUR per month

🔍 Industry: Software Development

🏢 Company: Softeta

⏳ Experience: 4+ years

🪄 Skills: PythonSQLApache AirflowETLAzureData engineeringCI/CDData modeling

Requirements:

4+ years of experience as a Data Engineer
Experience with Azure (Certifications are a Plus)
Experience with Databricks, Azure Data Lake, Data Factory and Apache Airflow
CI/CD or infrastructure as code
Knowledge of Medallion Architecture or Multihop architecture
Experience developing and administering ETL processes in the Cloud (Azure, AWS or GCP) environment
Strong programming skills in Python and SQL
Strong problem-solving and analytical skills

Responsibilities:

Design, develop, and maintain data pipelines and ETL processes
Data modeling, data cleansing
Automating data processing workflows using tools such as Airflow or other workflow management tools
Optimizing the performance of databases, including designing and implementing data structures and using indexes appropriately
Implement data quality and data governance processes
Being a data advocate and helping unlock business value by using data