Lead Data Engineer
New
J
JobgetherData engineering
Fully remote work arrangement within India.Full-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Proficiency in English at C2 level.
- Required Skills
- SQLApache AirflowGitSnowflakeApache KafkaSparkTerraformDatabricks
Requirements
- Bachelor's degree in Computer Science, Data Science, Statistics, or a related discipline; a master's degree in Data Science is also relevant.
- Strong professional experience in data engineering, including designing and implementing enterprise-scale Big Data solutions.
- Experience leading or guiding data engineering teams and providing technical mentorship.
- Proficiency with Apache Spark, Apache Kafka, and Apache Airflow.
- Experience designing and managing ETL processes, data pipelines, and integration workflows.
- Knowledge of data modeling, data quality management, and secure data engineering practices.
- Experience with Databricks and Snowflake platforms.
- Familiarity with AWS Data Pipeline and API integration.
- Strong SQL skills and experience with performance tuning and system performance monitoring.
- Experience with CI/CD practices, Git, and infrastructure automation using Terraform.
- Ability to translate business requirements into scalable technical solutions and collaborate with stakeholders.
- Proficiency in English at C2 level.
- Relevant certifications include Certified Data Management Professional, Databricks Certified Associate Developer for Apache Spark, Microsoft Certified: Azure Data Engineer Associate, or Oracle Database 12c Certified Implementation Specialist.
Responsibilities
- Lead and coordinate a team of data engineers in designing, developing, and implementing Big Data solutions.
- Design, build, and maintain scalable data pipelines and ETL processes for business and analytical requirements.
- Ensure data quality, integrity, consistency, and security across data platforms and systems.
- Collaborate with business stakeholders and technical teams to translate requirements into data engineering solutions.
- Provide technical direction and mentorship to data engineers and encourage engineering best practices.
- Monitor and troubleshoot data systems to improve performance, efficiency, reliability, and scalability.
- Oversee data integration and data modeling activities in line with architectural and business needs.
- Promote secure coding practices and contribute to CI/CD processes for data engineering workflows.
- Develop and maintain technical documentation for data processes, systems, pipelines, and infrastructure.
View Full Description & ApplyYou'll be redirected to the employer's site
