Senior Big Data Hadoop ML Engineer (GCP)

Posted 2024-08-09

💎 Seniority level: Senior, 10+ years

📍 Location: US

💸 Salary: 116100 - 198440 USD per year

🔍 Industry: Cloud Solutions

🗣️ Languages: English

⏳ Experience: 10+ years

🪄 Skills: PythonApache HadoopGCPHadoopJavaMachine LearningSparkTerraform

Proficiency in the Hadoop ecosystem including Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
Strong programming skills with Java, Python, and Spark.
Knowledge in public cloud services, particularly in GCP.
Experience in Infrastructure and Applied DevOps principles, including CI/CD and IaC like Terraform.
Ability to tackle complex challenges with innovative solutions.
Effective communication skills in a remote work setting.

Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, HBase.
Develop, manage, and maintain batch pipelines supporting Machine Learning workloads.
Leverage GCP for scalable big data processing and storage solutions.
Implement automation/DevOps best practices for CI/CD and IaC.

Posted 2024-11-07

📍 US

Extensive experience in the Apache Hadoop ecosystem such as Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
Proficiency in Java programming language.

Develop batch processing systems for data collection and batch inference.
Work within the Apache Hadoop ecosystem including technologies like Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
Contribute to the development of Machine Learning pipelines.

Apache HadoopHadoopJavaMachine LearningCommunication Skills

Posted 2024-11-07

🔧 Requirements