Research Engineer, Agentic AI Evals
Company:HUD
Location:USA, Singapore, Pacific Time (UTC-7:00/8:00), China/Singapore Time (UTC +8:00)
Languages:English
Seniority level:Senior, Not explicitly stated, learning potential prioritized
Experience:Not explicitly stated, learning potential prioritized
Skills:
DockerPythonSoftware DevelopmentReactLinux
Requirements:
Proficiency in Python, Docker, and Linux environments React experience for frontend development Production-level software development experience preferred Strong technical aptitude and demonstrated problem-solving ability Startup experience in early-stage technology companies Strong communication skills for remote collaboration Familiarity with current AI tools and LLM capabilities Understanding of safety and alignment considerations in AI systems Evidence of rapid learning and adaptability Hands-on experience with or contributed to LLM evaluation frameworks (EleutherAI, Inspect, or similar) Built custom evaluation pipelines or datasets Worked with agentic or multimodal AI evaluation systems
Responsibilities:
Build out environments for HUD's CUA evaluation datasets Deliver custom CUA datasets and evaluation pipelines requested by clients Contribute to improving the HUD evaluation harness
