Engineering Manager, Big Data, Job Understanding
New
Z
ZipRecruiterEmployment marketplace
Location: Remote. Most US-based positions can also be performed remotely.Full-TimeManager
Salary200,000 - 265,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of professional software development experience; 2+ years of experience as a software engineering leader
- Required Skills
- DockerHadoopKafkaKubernetesSpark
Requirements
- Have 5+ years of professional software development experience.
- Have 2+ years of experience as a software engineering leader.
- Have deep experience with modern big data frameworks such as Spark, Hadoop, or Hive.
- Have experience with streaming technologies such as Kafka, Flink, or Beam.
- Demonstrate strong computer science fundamentals, including data structures and algorithms, and strong coding skills.
- Have experience with containerization technologies such as Docker and Kubernetes.
- Have experience working on a B2C or B2B product.
- Have experience dealing with messy or unreliable data, including third-party data sets, data integrations, or migrations.
- Be able to work with product managers to understand problems and turn them into engineering solutions.
- Preferred: experience with cloud platforms such as GCP, AWS, or Azure.
- Preferred: experience with modern data storage solutions such as Delta Lake, HBase, or Hudi.
- Preferred: Scala experience.
Responsibilities
- Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores.
- Rebuild the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
- Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
- Lead improvements to fraud detection and blocking mechanisms.
- Partner with engineering stakeholders, data scientists, and a dedicated product manager to balance requests and roadmap priorities.
- Scale data pipelines for performance and maintainability.
- Enable the team to act on job data in a scalable, real-time manner.
View Full Description & ApplyYou'll be redirected to the employer's site