Lead Research Engineer, Data Quality
New
H
HUDArtificial Intelligence
Remote (Asia), Remote (North America), 70-80% overlap with San Francisco or Singapore time zones.Full-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- DockerPythonLinux
Requirements
- Advanced proficiency in Python, Docker, and Linux environments
- Deep intuition for data quality, specifically regarding task realism, reliability, and utility for training
- Experience building QC systems, evals, benchmarks, synthetic data pipelines, validation workflows, or model evaluation infrastructure
- Comfort working across messy human and technical systems including domain experts, vendors, and generated data
- Strong written communication with the ability to explain methodology clearly to internal and external audiences
- Ability to lead teams on ambiguous technical projects from problem definition through iteration
- Ability to work with subject-matter experts to capture domain judgment and convert it into scalable systems
- Proficiency in designing metrics, experiments, and QA/QC processes
- Experience in an early-stage startup environment with the ability to work independently
- High attention to detail to spot subtle inconsistencies or edge cases in data
Responsibilities
- Lead HUD’s data quality strategy including building QC systems, defining and enforcing quality standards, and designing experiments to grade agent outputs
- Develop new methods for validating synthetic data at scale, such as failure-mode analysis, task mutation checks, and trajectory auditing
- Partner with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation workflows
- Turn qualitative research insights into production systems, internal tools, dashboards, validation pipelines, and feedback loops
- Help build internal research taste around what makes agent training data actually useful, not just superficially correct
- Mentor other research engineers to maintain a high bar for technical rigor, clarity, and execution speed
View Full Description & ApplyYou'll be redirected to the employer's site