Senior Data Engineer (Azure/Databricks)
New
E
emagine PolskaData engineering
100% remotelyContractSenior
SalaryUp to 160 pln/h on b2b
Apply NowOpens the employer's application page
Job Details
- Languages
- Very good knowledge of English, with the ability to communicate effectively and explain and simplify technical topics for the business
- Experience
- 4+ years of experience in Azure and 6+ years of industrial experience in large-scale data management, visualization, and analytics
- Required Skills
- PythonSQLCI/CDGitHubAzure DevOps
Requirements
- Have 4+ years of experience in Azure.
- Have 6+ years of industrial experience in large-scale data management, visualization, and analytics.
- Bring strong hands-on experience with Azure Databricks, including data engineering, data processing, and analytics workloads.
- Have hands-on knowledge of Azure Data Lake, Azure SQL, and Azure Data Factory.
- Have good knowledge of SQL and Python.
- Have very good knowledge of English and be able to explain technical topics to business audiences.
- Bring a proactive approach, goal-oriented mindset, and strong problem-solving skills.
- Be willing to show up at the Warsaw office as needed for customer visits, workshops, or project periods requiring in-person teamwork.
- CI/CD pipeline design and implementation experience for data and analytics solutions is a plus, preferably with Azure DevOps.
- Experience with Databricks Workflows for data orchestration is a plus.
- A good understanding of DevOps practices, version control, automated testing, and deployment processes is a plus.
Responsibilities
- Design, develop, and maintain scalable data solutions in Azure Databricks for analytics and BI.
- Manage the full data lifecycle, from acquisition and integration to analysis and visualization.
- Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub, automating testing, deployment, and operations.
- Deliver end-to-end data and analytics projects, from requirements and architecture to implementation and deployment.
- Develop and optimize data pipelines, visualizations, analytics products, automated services, and APIs.
- Ingest and integrate data from diverse sources into scalable, maintainable data platforms.
- Ensure performance, reliability, scalability, and data quality of data solutions.
- Collaborate with multidisciplinary teams to turn data into models, insights, and production-ready solutions.
- Advise clients and stakeholders on data, Databricks, and solution architecture, identifying optimization opportunities.
View Full Description & ApplyYou'll be redirected to the employer's site