Senior Data Scientist, AI Evaluation
New
S
SylloLegal Tech
United States - RemoteFull-TimeSenior
Salary$160,000 — $200,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 2–4 years of relevant professional experience
- Required Skills
- PythonSQLData AnalysisMachine Learning
Requirements
- Master's degree in computer science, data science, machine learning, or a related field with substantial hands-on experience; or 2–4 years of relevant professional experience.
- Strong Python and SQL skills and experience working directly with production data.
- Comfortable navigating production code and data systems you did not build.
- Strong foundation in applied statistics, experimentation, and quantitative analysis.
- Practical experience working with and evaluating modern AI/ML systems.
- Experience diagnosing complex issues involving data, models, or production systems.
- Ability to turn ambiguous questions into structured investigations and clearly communicate the results.
Responsibilities
- Develop quantitative methods and tooling to evaluate AI system quality and performance.
- Design and run experiments to compare approaches, understand tradeoffs, and measure the impact of changes.
- Build repeatable processes to identify regressions, anomalies, and changes in system performance.
- Extract, transform, and analyze production data to support technical and product investigations.
- Diagnose complex issues involving data, models, and production systems, identifying root causes and potential solutions.
- Partner with Engineering to improve how system quality, reliability, and performance are measured.
- Build tools and dashboards that make system performance easier to understand and monitor.
- Clearly communicate findings, tradeoffs, and recommendations to technical and non-technical stakeholders.
View Full Description & ApplyYou'll be redirected to the employer's site
