Senior Software Engineer - Scoring

View full description

Requirements:

• 5+ years of experience as a data engineer or similar role, with hands-on experience in building data-focused solutions.
• Expertise in ETL, data pipeline design, and data engineering tools and technologies (e.g., Apache Spark, Hadoop, Airflow, Kafka).
• Experience with maintaining real-time and near real-time data pipelines or streaming services at high scale.
• Experience with maintaining large scale distributed systems on cloud platforms such as AWS, GCP, or Azure.
• Background in implementing data quality frameworks, including validation, monitoring, and anomaly detection.
• Proven ability to collaborate effectively with cross-functional teams.
• Excellent problem-solving skills and ability to work independently in a fast-paced environment.

Responsibilities:

• Architect, design, build, and deploy backend ETL jobs and infrastructure that support a world-class Detection Engine.
• Ownership projects that enable us to meet ambitious goals, including scaling components of Detection’s Data Pipeline by 10x.
• Own real-time, near real-time streaming pipelines and online feature serving services.
• Collaborate closely with MLE and Data Science teams, distilling feedback and executing strategy.
• Coach and mentor junior engineers through 1on1s, pair programming, code reviews, and design reviews.