Applied AI Engineer – Systems & Reliability
New
H
HiPeopleAI Hiring Platform
Location: WorldFull-TimeMiddle
SalaryCompetitive salary and meaningful stock options
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Machine LearningGoRegression testingCI/CDPrompt Engineering
Requirements
- 100% alignment with company Ops Principles.
- Strong proficiency in Go.
- Proven experience with AI/ML systems, LLMs, or data-intensive applications.
- High ownership mindset with meticulous attention to detail.
- Ability to debug complex systems spanning prompts, models, and data pipelines.
- Clear documentation and communication skills.
- Experience with evaluation methods, metrics, and experimentation (preferred).
- Familiarity with monitoring, CI/CD, and production system maintenance (preferred).
Responsibilities
- Build and maintain evaluation pipelines for AI workflows across screening, interviews, and assessments.
- Define metrics, benchmarks, and acceptance criteria to track quality, trends, and regressions.
- Improve AI performance through prompt strategies, model selection, fine-tuning, and data preprocessing.
- Build monitoring, dashboards, and alerting systems to detect failure modes and ensure stability.
- Integrate AI and prompt testing into CI/CD pipelines to prevent regressions.
- Conduct AI system audits and provide documentation for compliance standards like SOC 2.
- Productionize AI workflows to ensure robustness and maintainability.
View Full Description & ApplyYou'll be redirected to the employer's site
