Apply

Senior Big Data Hadoop ML Engineer (GCP)

Posted 5 months agoViewed

View full description

💎 Seniority level: Senior, 10+ years

📍 Location: US

💸 Salary: 116100 - 198440 USD per year

🔍 Industry: Cloud Solutions

🏢 Company: Rackspace👥 1001-5000💰 Private over 7 years ago🫂 Last layoff almost 2 years agoIaaSBig DataCloud ComputingCloud Infrastructure

🗣️ Languages: English

⏳ Experience: 10+ years

🪄 Skills: PythonApache HadoopGCPHadoopJavaMachine LearningSparkTerraform

Requirements:
  • Proficiency in the Hadoop ecosystem including Map Reduce, Oozie, Hive, Pig, HBase, and Storm.
  • Strong programming skills with Java, Python, and Spark.
  • Knowledge in public cloud services, particularly in GCP.
  • Experience in Infrastructure and Applied DevOps principles, including CI/CD and IaC like Terraform.
  • Ability to tackle complex challenges with innovative solutions.
  • Effective communication skills in a remote work setting.
Responsibilities:
  • Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, HBase.
  • Develop, manage, and maintain batch pipelines supporting Machine Learning workloads.
  • Leverage GCP for scalable big data processing and storage solutions.
  • Implement automation/DevOps best practices for CI/CD and IaC.
Apply