Lead Data Engineer – Remote Job.

View full description

Requirements:

• 3+ years of hands-on experience developing and managing data pipelines using PySpark
• Strong programming skills in Python and SQL
• Deep understanding of ETL processes and data warehousing fundamentals

Responsibilities:

• Design and develop scalable data pipelines
• Write efficient SQL and Python code
• Collaborate with machine learning engineers, product managers, and developers to understand data requirements and deliver solutions.
• Implement and maintain robust ETL processes
• Ensure data quality, integrity, and reliability
• Participate in code reviews, troubleshooting, and performance tuning.
• Work independently and proactively to identify and resolve data-related issues.
• If applicable, contribute to Azure-based data solutions
• Support cloud migration initiatives and DevOps practices, if relevant to the role.
• Provide guidance on best practices and mentor junior team members when needed.