Staff Data Engineer, Core Migrations
M
MachinifyHealthcare Intelligence
Work from anywhere in the US!Full-TimeStaff
Salary$180k-$220k
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- AWSPythonSQLApache AirflowETLData engineeringSpark
Requirements
- 8+ years of experience as a hands-on Data Engineer or Software Engineer.
- Demonstrated experience independently owning complex, multi-stakeholder technical projects.
- Fluent in Python and SQL, including working with unfamiliar legacy code.
- Deep understanding of Apache Spark for distributed processing and performance tuning.
- Advanced experience with Apache Airflow for designing and authoring production DAG architectures.
- Active use of coding agents (e.g., Claude, Copilot, Cursor) for engineering tasks.
- Experience reverse-engineering legacy ETL stacks (SSIS, T-SQL, SQL Server stored procedures).
- Proficiency with AWS data patterns (S3, partitioned object storage, secure cross-account access).
- Experience building automated reconciliation frameworks to guarantee data fidelity.
- Strong technical communication skills for authoring specs, architectural documentation, and stakeholder updates.
- Ability to drive alignment across cross-functional teams including operations and client-facing roles.
Responsibilities
- Lead discovery and technical due diligence of legacy ETL, stored procedures, and reporting layers.
- Reverse-engineer complex, undocumented legacy systems to reconstruct embedded business logic.
- Architect and build migration pipelines using production-grade Airflow DAGs and Spark jobs.
- Build automated reconciliation frameworks to confirm migrated output matches source data row-by-row.
- Own the full project lifecycle from kickoff through go-live, coordinating across Operations, Client Success, and Engineering.
- Document architectural decisions and institutionalize migration knowledge through runbooks and retrospectives.
- Mentor L3/L4 engineers and develop scalable, reusable migration tooling.
View Full Description & ApplyYou'll be redirected to the employer's site