Lead Data Engineer
New
US-basedContractLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonSQLKafkaSnowflakeData modelingBigQuery
Requirements
- 7+ years of experience in data engineering within cloud or hybrid environments.
- Strong experience designing, building, and maintaining production-scale ETL/ELT pipelines.
- Advanced SQL skills and proficiency with data transformation techniques.
- Strong Python programming skills for data processing and automation.
- Hands-on experience with Snowflake, including data modeling, Snowpipe, and query optimization.
- Experience migrating from BigQuery or similar columnar data warehouse technologies.
- Experience with batch and streaming data processing platforms such as Kafka, Event Hub, or equivalent.
- Experience building enterprise-grade API and source-system integrations.
- Experience implementing data quality and validation frameworks.
- Understanding of data governance, data lineage, access control, and security best practices.
Responsibilities
- Lead the design, development, and optimization of scalable data platforms and pipelines.
- Design, build, and maintain production-grade ETL/ELT workflows for batch and near real-time data processing.
- Drive the migration and modernization of data assets from BigQuery and other analytical platforms into Snowflake.
- Develop robust integrations with enterprise applications, APIs, and external data providers.
- Build and optimize Snowflake data models, schemas, Snowpipe ingestion processes, and query performance.
- Collaborate with business stakeholders, analysts, and engineering teams to translate business requirements into scalable data solutions.
- Implement data quality, validation, monitoring, and observability frameworks.
- Establish and promote best practices for data governance, lineage tracking, metadata management, and security.
- Support both batch and streaming data architectures using technologies such as Kafka, Event Hub, or equivalent.
- Mentor other engineers and contribute to architectural decisions, technical standards, and engineering best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
