Data Engineering Solution Lead
New
J
JobgetherData engineering
Based in the United StatesFull-TimeLead
Salary105,000 - 155,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 5 years of hands-on data engineering experience; at least 3 years of Snowflake experience.
- Required Skills
- PythonSQLMongoDBSnowflake
Requirements
- At least 5 years of hands-on data engineering experience designing, building, and supporting ETL/ELT pipelines in complex enterprise environments.
- At least 3 years of Snowflake experience, including dynamic tables, views, performance optimization, and schema design.
- Advanced SQL and Python skills for data processing, validation, troubleshooting, and pipeline support.
- Experience leading technical design for large-scale data migrations or platform conversions, including source-to-target mapping and reusable conversion standards.
- Strong Informatica expertise and practical experience with Matillion or a comparable cloud-native data integration platform.
- Experience using AI-assisted technologies for large-scale pipeline conversion and setting review and verification standards for AI-generated outputs.
- Strong testing and data validation skills, including identifying, investigating, and resolving data quality issues independently.
- Experience leading and mentoring Agile engineering teams.
- A bachelor's degree in Computer Science, Data Science, Engineering, or a related field is preferred, or equivalent education and professional experience.
- Experience migrating Informatica pipelines to Matillion is highly desirable.
- Use sound judgment in the ethical, secure, and compliant use of AI, particularly with confidential and customer information.
Responsibilities
- Own the end-to-end technical design for migrating Informatica pipelines to Matillion and Snowflake, including target architecture, orchestration, error handling, and operational standards.
- Define repeatable processes for discovering, classifying, converting, testing, and promoting pipelines.
- Build and maintain a shared library of reusable conversion patterns and technical components.
- Design connector and authentication approaches for on-premises systems, Azure SQL Server, files, APIs, and MongoDB.
- Establish testing standards, validation processes, and sign-off requirements for migration quality.
- Review pipelines, test evidence, and technical documentation, and request corrections when needed.
- Scale AI-assisted pipeline conversion with quality controls, verification processes, and human oversight.
- Coordinate client priorities, delivery sequencing, cutover readiness, and delivery risks with stakeholders and internal leadership.
- Lead daily delivery activities and coordinate with data acquisition teams to meet May and June fiscal year-end milestones.
- Mentor and develop data engineers and evaluate tools and practices to improve productivity and solution quality.
View Full Description & ApplyYou'll be redirected to the employer's site