Senior Big Data Hadoop ML Engineer (GCP) - Canada

Posted 2024-08-23

💎 Seniority level: Senior, 10+ years in customer-facing software/technology or consulting, 5+ years in cloud migrations or IT transformations

📍 Location: Canada

💸 Salary: 100000 - 120000 CAD per year

🔍 Industry: Multicloud solutions

🗣️ Languages: English

⏳ Experience: 10+ years in customer-facing software/technology or consulting, 5+ years in cloud migrations or IT transformations

🪄 Skills: Apache HadoopGCPHadoopJavaMachine LearningSparkCommunication SkillsCI/CDTerraform

Proficiency in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm.
Strong programming skills with Java, Python, and Spark.
Knowledge in public cloud services, particularly in GCP.
Experience in Infrastructure and Applied DevOps principles.
Hands-on experience in public cloud platforms, particularly GCP.
Proven experience in engineering batch processing systems at scale.

Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, HBase.
Develop, manage, and maintain batch pipelines supporting Machine Learning workloads.
Leverage GCP for scalable big data processing and storage solutions.
Implement automation and DevOps best practices for CI/CD, IaC.

Posted 2024-11-07

📍 Canada

Join a dynamic team as a Senior Big Data Engineer.
Develop batch processing systems for data collection and batch inference.
Work extensively with the Apache Hadoop ecosystem tools such as Map Reduce, Oozie, Hive, Pig, HBase, and Storm.

Apache HadoopHadoopJavaMachine LearningCommunication Skills

Posted 2024-11-07

🔧 Requirements