Senior Machine Learning Engineer, Personalization
New
S
SpotifyMusic & Audio
New York, NYFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- Machine LearningContent managementDebugging
Requirements
- 5+ years of production machine learning experience deploying highly impactful products.
- Deep background in machine learning.
- Experience building, evaluating, and handling hard problems with agentic experiences.
- Expertise in context handling, multi-step reasoning, and ambiguity at scale.
- Proven ability to design evaluation metrics and build evaluation pipelines.
- Experience with judge alignment and developing intuition through data analysis.
- Ability to debug messy interactions between models, tools, and system constraints like latency.
- Comfortable with rapid prototyping and shipping features to users.
Responsibilities
- Build and improve core agentic capabilities such as memory, context management, and multi-step tool use.
- Design and calibrate evaluation frameworks including LLM-as-judge to accelerate confidence in agent behavior.
- Increase offline-to-online success through rigorous testing.
- Prototype, dogfood, ship, and refine new features in tight feedback loops.
- Debug interactions between models, tools, and system constraints.
View Full Description & ApplyYou'll be redirected to the employer's site
