Research Engineer, QC Automation
New
C
CleraAI Infrastructure
On-site in Singapore. Candidates based in San Francisco or fully remote independent contractors (particularly from Europe) may also be considered depending on location.Full-TimeMiddle
Salary150,000 - 250,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 2 to 4 years
- Required Skills
- DockerPythonData engineeringLinux
Requirements
- 2 to 4 years of experience in engineering or research roles, ideally with a focus on QC automation or data quality.
- Proficiency in Python, Docker, and Linux environments.
- Proven experience building scalable data validation pipelines and automated QA/QC systems end-to-end.
- Experience working on benchmarks and evaluations for RL training data.
- Experience creating QC systems based on human judgment rather than LLM-centric approaches.
- Experience designing experiments and metrics to grade agent outputs.
- Experience partnering with data vendors to provide actionable feedback.
- Solid knowledge of statistics and comfort designing metrics and QA/QC processes.
- Strong written and verbal communication skills for working across time zones.
- Ability to work independently in a fast-paced startup environment.
Responsibilities
- Automate QC for training data created by companies using the platform's infrastructure.
- Build QC systems grounded in true understanding and human judgment.
- Define and enforce quality standards for training data across the platform.
- Design experiments and metrics to evaluate and grade agent outputs.
- Partner with data vendors to debug quality issues, diagnose agent failure modes, and improve their data generation processes.
- Translate QC learnings into auditing systems, including sampling strategies and rule-based or model-assisted validation pipelines.
- Continuously integrate QC insights into infrastructure tools and vendor-facing systems.
View Full Description & ApplyYou'll be redirected to the employer's site
