Lead Data Engineer
New
United StatesFull-TimeLead
Salary120,000 - 157,500 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of proven experience in the design and implementation of data warehouse architecture
- Required Skills
- PythonSQLETLAzureSparkData modeling
Requirements
- Bachelor’s degree in Computer Science or a related field or equivalent work experience.
- 8+ years of experience in data warehouse architecture design, data delivery, data modeling, ETL tools, and master data management.
- 5+ years of experience with Microsoft Cloud Data Platform Solutions: Microsoft Fabric OneLake, Azure Synapse, DevOps, Data Factory, Pipelines, and Notebooks.
- Strong experience with Medallion Architecture Modeling.
- Proficiency in Python programming and data processing (dataframes, Spark, etc.).
- SQL development and performance optimization expertise.
- Experience with monitoring and optimization tools like Azure Monitor or Application Insights.
- Strong communicative, analytical, problem-solving, and organizational skills.
- Ability to mentor team members in cloud technologies.
- Capacity to provide 24-hour on-call support, including evenings and weekends.
Responsibilities
- Design and deliver data engineering solutions leveraging Microsoft Fabric and Azure Synapse Analytics, including pipelines, notebooks, and lakehouse architectures.
- Lead cross-functional team members in building modern data warehousing solutions from blueprinting through implementation and support.
- Interface with management and stakeholders to determine requirements and estimate work effort.
- Provide guidance on data governance, security, and privacy across the cloud environment.
- Mentor and develop junior data engineers and lead problem-solving for performance and support issues.
- Accountable for disaster recovery, change management, and establishing service delivery standards.
- Evaluate third-party solutions and stay current with emerging technologies.
View Full Description & ApplyYou'll be redirected to the employer's site