Data Engineering Solution Lead

New
J
JobgetherData engineering
Based in the United StatesFull-TimeLead
Salary105,000 - 155,000 USD per year
Apply NowOpens the employer's application page

Job Details

Experience
At least 5 years of hands-on data engineering experience; at least 3 years of Snowflake experience.
Required Skills
PythonSQLMongoDBSnowflake

Requirements

  • At least 5 years of hands-on data engineering experience designing, building, and supporting ETL/ELT pipelines in complex enterprise environments.
  • At least 3 years of Snowflake experience, including dynamic tables, views, performance optimization, and schema design.
  • Advanced SQL and Python skills for data processing, validation, troubleshooting, and pipeline support.
  • Experience leading technical design for large-scale data migrations or platform conversions, including source-to-target mapping and reusable conversion standards.
  • Strong Informatica expertise and practical experience with Matillion or a comparable cloud-native data integration platform.
  • Experience using AI-assisted technologies for large-scale pipeline conversion and setting review and verification standards for AI-generated outputs.
  • Strong testing and data validation skills, including identifying, investigating, and resolving data quality issues independently.
  • Experience leading and mentoring Agile engineering teams.
  • A bachelor's degree in Computer Science, Data Science, Engineering, or a related field is preferred, or equivalent education and professional experience.
  • Experience migrating Informatica pipelines to Matillion is highly desirable.
  • Use sound judgment in the ethical, secure, and compliant use of AI, particularly with confidential and customer information.

Responsibilities

  • Own the end-to-end technical design for migrating Informatica pipelines to Matillion and Snowflake, including target architecture, orchestration, error handling, and operational standards.
  • Define repeatable processes for discovering, classifying, converting, testing, and promoting pipelines.
  • Build and maintain a shared library of reusable conversion patterns and technical components.
  • Design connector and authentication approaches for on-premises systems, Azure SQL Server, files, APIs, and MongoDB.
  • Establish testing standards, validation processes, and sign-off requirements for migration quality.
  • Review pipelines, test evidence, and technical documentation, and request corrections when needed.
  • Scale AI-assisted pipeline conversion with quality controls, verification processes, and human oversight.
  • Coordinate client priorities, delivery sequencing, cutover readiness, and delivery risks with stakeholders and internal leadership.
  • Lead daily delivery activities and coordinate with data acquisition teams to meet May and June fiscal year-end milestones.
  • Mentor and develop data engineers and evaluate tools and practices to improve productivity and solution quality.
View Full Description & ApplyYou'll be redirected to the employer's site
105,000 - 155,000 USD per year
Apply Now