Senior Data Engineer
New
L
Lumicode Sp. z o.o.Data engineering
Workplace type: remoteFull-TimeSenior
Salary130 - 145 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLSparkAzure DevOps
Requirements
- Have strong experience with Python, SQL, and Apache Spark.
- Bring hands-on experience with the Azure Data Platform, including Azure Databricks, Data Factory, Data Lake, and Synapse Analytics.
- Have experience designing and maintaining ETL/ELT pipelines.
- Know Delta Live Tables (DLT), Unity Catalog, and Lakehouse architecture.
- Have experience with Databricks workflows, CI/CD, and Azure DevOps.
- Understand infrastructure automation, monitoring, logging, and data governance.
- Be familiar with Power BI and Azure Data Explorer.
- Demonstrate analytical and problem-solving skills.
- Be able to work independently, take ownership, and proactively drive initiatives.
- Bring communication and collaboration skills and experience working in cross-functional teams.
Responsibilities
- Design, develop, and optimize scalable data solutions within the Azure ecosystem.
- Build and maintain ETL/ELT pipelines using Python, SQL, and Spark.
- Develop Databricks workflows, DLT pipelines, and metadata-driven solutions.
- Support data platform migrations, modernization, and Unity Catalog implementation.
- Ensure data quality, security, performance, and reliability.
- Contribute to CI/CD, infrastructure automation, monitoring, and troubleshooting.
- Collaborate with Data Architects, analysts, and business stakeholders to deliver data solutions.
- Optimize data processing and storage costs while following Lakehouse and governance principles.
View Full Description & ApplyYou'll be redirected to the employer's site