Staff Data Engineer, Core Migrations

M
MachinifyHealthcare Intelligence
Work from anywhere in the US!Full-TimeStaff
Salary$180k-$220k
Apply NowOpens the employer's application page

Job Details

Experience
8+ years
Required Skills
AWSPythonSQLApache AirflowETLData engineeringSpark

Requirements

  • 8+ years of experience as a hands-on Data Engineer or Software Engineer.
  • Demonstrated experience independently owning complex, multi-stakeholder technical projects.
  • Fluent in Python and SQL, including working with unfamiliar legacy code.
  • Deep understanding of Apache Spark for distributed processing and performance tuning.
  • Advanced experience with Apache Airflow for designing and authoring production DAG architectures.
  • Active use of coding agents (e.g., Claude, Copilot, Cursor) for engineering tasks.
  • Experience reverse-engineering legacy ETL stacks (SSIS, T-SQL, SQL Server stored procedures).
  • Proficiency with AWS data patterns (S3, partitioned object storage, secure cross-account access).
  • Experience building automated reconciliation frameworks to guarantee data fidelity.
  • Strong technical communication skills for authoring specs, architectural documentation, and stakeholder updates.
  • Ability to drive alignment across cross-functional teams including operations and client-facing roles.

Responsibilities

  • Lead discovery and technical due diligence of legacy ETL, stored procedures, and reporting layers.
  • Reverse-engineer complex, undocumented legacy systems to reconstruct embedded business logic.
  • Architect and build migration pipelines using production-grade Airflow DAGs and Spark jobs.
  • Build automated reconciliation frameworks to confirm migrated output matches source data row-by-row.
  • Own the full project lifecycle from kickoff through go-live, coordinating across Operations, Client Success, and Engineering.
  • Document architectural decisions and institutionalize migration knowledge through runbooks and retrospectives.
  • Mentor L3/L4 engineers and develop scalable, reusable migration tooling.
View Full Description & ApplyYou'll be redirected to the employer's site
$180k-$220k
Apply Now