Senior Data Scientist — Model Evaluation
New
S
SumerSportsSports Analytics
United StatesFull-TimeSenior
SalaryUSD 135000 - 165000 / year
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Machine LearningData scienceDeep Learning
Requirements
- Strong statistical foundations including calibration, bootstrapping, and inter-rater reliability.
- Proven track record in model evaluation within a production ML team.
- Experience with production ML pipelines, including managing schema drift, label noise, and leakage.
- Demonstrated ability to build rather than just consume tooling.
- Self-starter capable of taking strategic direction and shaping own path.
- AI-native approach to building skills, loops, and tooling.
- Commitment to staying current with research papers, releases, and new techniques.
- Demonstrated domain absorption capacity in complex fields such as sports, finance, or biotech.
Responsibilities
- Contribute to model evaluation across football models and drive end-to-end projects.
- Build and extend tooling used to test, compare, and ship models.
- Design evaluation processes with football subject-matter experts to ensure real-world applicability.
- Detect and prevent silent regressions prior to model shipment.
- Critically evaluate stakeholder requests regarding metrics to ensure validity.
- Develop experimentation harnesses to facilitate rapid testing of new ideas.
View Full Description & ApplyYou'll be redirected to the employer's site