Senior Data Engineer (GCP) - AI Platforms

View full description

Requirements:

• 5+ years of relevant development experience writing high-quality code as a Data Engineer
• Have actively participated in the design and development of data architectures
• Hands-on experience in developing and optimizing data pipelines
• Comprehensive understanding of data modeling, ETL processes, and both SQL and NoSQL databases
• Experience with a general-purpose programming language such as Python or Scala
• Experience with GCP platforms and services.
• Experience with containerization technologies such as Docker and Kubernetes
• Proven track record in implementing and optimizing data warehousing solutions and data lakes
• Proficiency in DevOps practices and automation tools for continuous integration and deployment of data solutions
• Experience with machine learning workflows and supporting data scientists in model deployment
• Solid understanding of data security and compliance requirements in large-scale data environments
• Strong ability to communicate effectively with teams and stakeholders, providing and receiving feedback to improve product outcomes.
• Proficient in communicating and writing in English

Responsibilities:

• Develop and optimize scalable, high-performing, secure, and reliable data pipelines that address diverse business needs and considerations
• Identify opportunities to enhance internal processes, implement automation to streamline manual tasks, and contribute to infrastructure redesign
• Help mentor and coach a product team towards shared goals and outcomes
• Navigate difficult conversations by providing constructive feedback to teams
• Identify obstacles to ensure quality, improve our user experience and how we build tests
• Be self-aware of limitations, yet curious to learn new solutions while being receptive to constructive feedback from teammates
• Engage in ongoing research and adoption of new technologies, libraries, frameworks, and best practices to enhance the capabilities of the data team