Senior LLM Systems Engineer
New
R
Risk LabsCrypto Oracle Infrastructure
100% remoteFull-TimeSenior
SalarySalaries for this role range from $100-200k (USD)
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- PythonTypeScriptPostgresPrompt Engineering
Requirements
- 3+ years of professional software engineering experience in Python, TypeScript, or similar production languages.
- Hands-on experience building production systems that use LLMs, agents, retrieval, or structured outputs.
- Experience designing evaluations, test datasets, regression checks, or manual review loops for AI systems.
- Strong debugging ability across APIs, databases, queues, logs, and model outputs.
- Practical understanding of prompt engineering, tool calling, and common LLM failure modes.
- Ability to reason carefully about correctness in uncertain or adversarial environments.
- High agency and strong ownership.
- Clear written communication skills.
Responsibilities
- Improve prompts, model selection, tool usage, and retrieval to increase system decision accuracy.
- Reduce latency, token usage, and costs while maintaining operational reliability.
- Design validation, retries, fallbacks, and uncertainty handling for complex inputs.
- Build evaluation datasets, regression tests, and monitoring dashboards to ensure model quality.
- Improve agent orchestration and tool usage across services, APIs, and external data sources.
- Debug production issues, investigate regressions, and optimize operational runbooks.
View Full Description & ApplyYou'll be redirected to the employer's site
