AI Research Engineer
New
G
GauntletAI, DeFi
Remote first — work from anywhere in the United StatesFull-Time
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- We expect strong candidates to have experience working in a professional engineering or research environment, but we're more interested in what you've built and how you approach problems than a specific number of years on your CV.
- Required Skills
- PythonMachine LearningContent managementData science
Requirements
- Have hands-on experience building, evaluating or improving LLM models or agents through professional work, applied research, open-source contributions or substantial personal projects.
- Have strong Python skills and good software engineering fundamentals.
- Be comfortable writing production-quality code and understand testing, maintainability and reliability.
- Have experience with applied research, machine learning or data science, including designing experiments and working with datasets.
- Understand how LLM agents work beyond prompting, including tool use, harnesses, context management and common failure modes.
- Be able to break open-ended problems into testable questions and work independently.
- Have experience building tools or systems used by others and evaluating their effectiveness beyond technical benchmarks.
- Be comfortable working across research and engineering and collaborating with different teams.
Responsibilities
- Build evaluation frameworks for AI agents, including datasets, sandbox environments and metrics for real-world tasks.
- Design experiments to compare models, agent harnesses, tools and execution environments, and identify regressions and trade-offs.
- Turn qualitative feedback about agent behavior into research questions, experiments and measurable outcomes.
- Investigate agent failures and develop ways to improve performance.
- Build and improve agent harnesses, internal tools and integrations, including Aria and other business agents.
- Develop shared knowledge and reusable skills across agents.
- Work with Infrastructure and Security to help agents operate reliably and safely in production.
View Full Description & ApplyYou'll be redirected to the employer's site
