Manager, Data Engineering
New
S
SkillableData engineering
Skillable can only hire potential candidates with a primary residence in the following States: AZ, CA, CO, FL, GA, ID, IN, KY, MA, ME, MI, MO, NC, ND, NE, NH, NV, NY, OH, OK, SC, TN, TX, UT, WA, WI.Full-TimeManager
SalaryThe base salary for this position is $140,000 - $185,000 annually.
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ years of relevant professional experience in software / data engineering; 2+ years of experience in a lead capacity.
- Required Skills
- Microsoft SQL ServerSparkdbtDatabricks
Requirements
- Bachelor’s degree in Computer Science, Data Science, Engineering, or relevant professional experience.
- 10+ years of relevant professional experience in software or data engineering.
- Experience building production data pipelines and data platforms.
- 2+ years of experience in a lead capacity, including team leadership, task breakdown, reviews, delivery ownership, and cross-functional coordination.
- Direct experience managing a team, including hiring or interviewing and conducting formal performance reviews.
- Hands-on experience with Databricks (Spark), Boomi/Rivery, and Delta Lake patterns for lakehouse processing.
- Experience designing and implementing ETL/ELT and orchestration or ingestion-to-transformation workflows across curated layers.
- Experience working with application and database teams on data access patterns for upstream SQL Server systems, including read replicas, CDC, snapshot isolation, or batching strategies.
- Expertise implementing Medallion architecture across Bronze, Silver, and Gold, including layer guardrails.
- Understanding of ingestion sources such as APIs, CDC-enabled databases, and file drops, and selecting ingestion strategies for source contracts.
- Experience improving engineering standards, patterns, documentation, and predictable delivery, and mentoring or training team members.
Responsibilities
- Manage the team, including hiring and onboarding, setting expectations, conducting performance reviews, and coaching team members.
- Translate enterprise data platform architecture direction into sequenced execution plans, backlogs, and measurable outcomes.
- Set engineering standards for maintainability, organization, repeatability, and team performance.
- Plan and manage day-to-day execution, including task breakdown, sprint planning, delegation, delivery unblocking, and engineering reviews.
- Drive implementation of Bronze, Silver, and Gold Medallion architecture using Boomi, dbt, Azure Databricks, Boomi/Rivery, Delta tables, and SQL Server.
- Partner with the Data Architect to establish implementation patterns, reference pipelines, and guardrails.
- Establish DataOps practices, including CI/CD for data assets, branching and release patterns, code reviews, and operational runbooks.
- Improve pipeline monitoring for freshness, failures, and data quality, and coordinate incident and support responses.
- Partner with business stakeholders to clarify requirements and shape requests into scoped work aligned with platform strategy.
- Mentor engineers and develop future leaders through coaching, delegation, and succession planning.
View Full Description & ApplyYou'll be redirected to the employer's site
