Principal Engineer (R13689)

14+ years of related experience in data engineering, with a Bachelor's degree in Computer Science; or a Master's degree with an equivalent combination of education and experience. Extensive experience orchestrating the development of end-to-end data engineering pipelines including data analytics for intricate and large-scale applications. Proven record of transformative leadership, guiding technical teams. Profound mastery of data engineering architecture and frameworks across batch and stream processing (Hadoop ecosystem, Medallion architecture, Databricks or equivalent data warehouse / data lake platforms), coupled with Python / PySpark programming. Thorough comprehension of software engineering principles, data governance and collaborative development workflows. Adeptness with cloud platforms (AWS / Azure / GCP) and utilization of cloud-native services. Track record of successfully integrating DevOps practices, continuous integration, and continuous deployment (CI/CD) pipelines. Superior problem-solving acumen. Exceptional communication aptitude.

Set strategic vision and lead implementation of data infrastructure roadmap. Provide technical leadership, mentoring, and guidance to data engineers. Collaborate with data scientists to translate model requirements into optimized data pipelines. Spearhead best practices for data platform experimentation and decision making. Engineer automated CI/CD pipelines for deployment and optimization. Define and optimize performance benchmarks for data infrastructure. Work with teams to design, develop, and test software and data systems components using agile methodology. Drive data engineering practices for product development execution and operational excellence. Integrate latest advancements into the data ecosystem.