Research Engineer, QC Automation
New
C
CleraAI Infrastructure
Fully remote as an independent contractor for candidates based elsewhere, particularly in EuropeFull-TimeMiddle
Salary150,000 - 250,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 2–4 years
- Required Skills
- DockerPythonData engineeringLinuxQuality Assurance
Requirements
- 2–4 years of experience in engineering or research roles.
- Proficiency in Python, Docker, and Linux environments.
- Strong understanding of what "good data" means and how to measure it.
- Proven experience building scalable data validation pipelines and automated QA/QC systems end-to-end.
- Experience working on benchmarks and evals—including reasoning about realistic tasks, reliable rubrics, and useful trajectories for RL training.
- Knowledge of statistics and comfort designing metrics, experiments, and QA/QC processes.
- Strong written and verbal communication skills for collaborating across time zones.
- Genuine curiosity across domains and an ability to ask questions that drive understanding.
- Ability to thrive in unstructured problem spaces and work independently in a fast-paced, early-stage startup environment.
Responsibilities
- Automate quality control for training data produced by companies using the platform's infrastructure.
- Build QC systems grounded in true understanding and human judgment.
- Define and enforce quality standards for post-training datasets.
- Design experiments and metrics to grade agent outputs.
- Partner with data vendors to debug quality issues, diagnose agent failure modes, and improve data generation processes.
- Translate QC learnings into auditing systems, including sampling strategies and rule-based or model-assisted validation pipelines.
- Continuously integrate QC learnings into infrastructure tooling and the data vendor portal.
View Full Description & ApplyYou'll be redirected to the employer's site
