Engineering Manager, Big Data, Job Understanding

New
Z
ZipRecruiterEmployment marketplace
Location: Remote. Most US-based positions can also be performed remotely.Full-TimeManager
Salary200,000 - 265,000 USD per year
Apply NowOpens the employer's application page

Job Details

Experience
5+ years of professional software development experience; 2+ years of experience as a software engineering leader
Required Skills
DockerHadoopKafkaKubernetesSpark

Requirements

  • Have 5+ years of professional software development experience.
  • Have 2+ years of experience as a software engineering leader.
  • Have deep experience with modern big data frameworks such as Spark, Hadoop, or Hive.
  • Have experience with streaming technologies such as Kafka, Flink, or Beam.
  • Demonstrate strong computer science fundamentals, including data structures and algorithms, and strong coding skills.
  • Have experience with containerization technologies such as Docker and Kubernetes.
  • Have experience working on a B2C or B2B product.
  • Have experience dealing with messy or unreliable data, including third-party data sets, data integrations, or migrations.
  • Be able to work with product managers to understand problems and turn them into engineering solutions.
  • Preferred: experience with cloud platforms such as GCP, AWS, or Azure.
  • Preferred: experience with modern data storage solutions such as Delta Lake, HBase, or Hudi.
  • Preferred: Scala experience.

Responsibilities

  • Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores.
  • Rebuild the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
  • Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
  • Lead improvements to fraud detection and blocking mechanisms.
  • Partner with engineering stakeholders, data scientists, and a dedicated product manager to balance requests and roadmap priorities.
  • Scale data pipelines for performance and maintainability.
  • Enable the team to act on job data in a scalable, real-time manner.
View Full Description & ApplyYou'll be redirected to the employer's site
200,000 - 265,000 USD per year
Apply Now