Senior Big Data Hadoop ML Engineer (GCP) - Canada

Posted 2024-11-07

View full description

💎 Seniority level: Senior

📍 Location: Canada

🗣️ Languages: English

🪄 Skills: Apache HadoopHadoopJavaMachine LearningCommunication Skills

Requirements:

Extensive experience in the Apache Hadoop ecosystem.
Proficiency in Java programming.
Experience with designing and implementing Machine Learning pipelines.

Responsibilities:

Join a dynamic team as a Senior Big Data Engineer.
Develop batch processing systems for data collection and batch inference.
Work extensively with the Apache Hadoop ecosystem tools such as Map Reduce, Oozie, Hive, Pig, HBase, and Storm.

Related Jobs

🔥 Senior Big Data Hadoop ML Engineer (GCP) - Canada

Posted 2024-08-23

📍 Canada

🧭 Full-Time

💸 100000 - 120000 CAD per year

🔍 Multicloud solutions

🏢 Company: Rackspace👥 1001-5000💰 $ Private on 2017-09-11🫂 on 2023-03-27IaaS Big Data Cloud Computing Cloud Infrastructure

Proficiency in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm.
Strong programming skills with Java, Python, and Spark.
Knowledge in public cloud services, particularly in GCP.
Experience in Infrastructure and Applied DevOps principles.
Hands-on experience in public cloud platforms, particularly GCP.
Proven experience in engineering batch processing systems at scale.

Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, HBase.
Develop, manage, and maintain batch pipelines supporting Machine Learning workloads.
Leverage GCP for scalable big data processing and storage solutions.
Implement automation and DevOps best practices for CI/CD, IaC.

Apache HadoopGCPHadoopJavaMachine LearningSparkCommunication SkillsCI/CDTerraform

Posted 2024-08-23