Senior Big Data Hadoop ML Engineer (GCP)

Posted 2024-11-07

View full description

💎 Seniority level: Senior

📍 Location: US

🗣️ Languages: English

🪄 Skills: Apache HadoopHadoopJavaMachine LearningCommunication Skills

Requirements:

Extensive experience in the Apache Hadoop ecosystem such as Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
Proficiency in Java programming language.

Responsibilities:

Develop batch processing systems for data collection and batch inference.
Work within the Apache Hadoop ecosystem including technologies like Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
Contribute to the development of Machine Learning pipelines.

Related Jobs

🔥 Senior Big Data Hadoop ML Engineer (GCP)

Posted 2024-08-09

📍 US

💸 116100 - 198440 USD per year

🔍 Cloud Solutions

🏢 Company: Rackspace👥 1001-5000💰 $ Private on 2017-09-11🫂 on 2023-03-27IaaS Big Data Cloud Computing Cloud Infrastructure

Proficiency in the Hadoop ecosystem including Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
Strong programming skills with Java, Python, and Spark.
Knowledge in public cloud services, particularly in GCP.
Experience in Infrastructure and Applied DevOps principles, including CI/CD and IaC like Terraform.
Ability to tackle complex challenges with innovative solutions.
Effective communication skills in a remote work setting.

Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, HBase.
Develop, manage, and maintain batch pipelines supporting Machine Learning workloads.
Leverage GCP for scalable big data processing and storage solutions.
Implement automation/DevOps best practices for CI/CD and IaC.

PythonApache HadoopGCPHadoopJavaMachine LearningSparkTerraform

Posted 2024-08-09