Product-Focused Data Scientist (LLM Products)
New
B
Blue Rose ResearchPolitical Research
Remote or NYCFull-TimeSenior
Salary160,000 - 210,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonSQLMachine Learning
Requirements
- 5+ years of experience as a data scientist or applied statistician.
- Proven experience shipping features or products.
- Proficiency in Python and SQL.
- Experience with standard statistical and machine learning tooling.
- Hands-on experience evaluating or building on top of LLMs.
- Experience designing evaluation sets and building LLM-as-judge pipelines.
- Experience working with embeddings.
- Strong product instincts and user-centered design approach.
- Clear communication skills for technical and non-technical audiences.
- Ability to thrive in ambiguous environments and translate complex goals into actionable metrics.
Responsibilities
- Collaborate with political strategists to translate their needs into product decisions.
- Design workflows that integrate human and AI agent interaction.
- Define quality metrics for AI systems, balancing rigor with pragmatic user needs.
- Develop evaluation frameworks and LLM-as-judge systems for accuracy and grounding.
- Prototype new ideas rapidly using coding agents.
- Communicate technical findings and tradeoffs to both technical and non-technical stakeholders.
View Full Description & ApplyYou'll be redirected to the employer's site
