Prompt Systems Engineer
New
N
NoodleEdTech
Remote, United StatesFull-TimeMiddle
Salary$100,000 - $120,000 a year
Apply NowOpens the employer's application page
Job Details
- Experience
- 2+ years
- Required Skills
- PythonJavascriptPrompt Engineering
Requirements
- 2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment.
- Familiarity with prompt patterns including few-shot, chain-of-thought, system/user roles, output formatting, and tool-use.
- Deep understanding of RAG (Retrieval-Augmented Generation) integration.
- Experience building and running prompt evaluations, including defining metrics and writing test cases.
- Familiarity with LLM observability tools such as Langfuse, Weights & Biases, or similar.
- Comfort reading and writing basic code in JavaScript or Python for prompt automation and testing.
- Knowledge of OpenAI, Anthropic, or other major model provider APIs.
- Familiarity with Learning Tools Interoperability (LTI) and LMS platforms like Canvas or Moodle.
- Strong written communication skills for writing precise agent instructions.
- Ability to work across disciplines, translating technical concepts for non-technical stakeholders.
Responsibilities
- Write, iterate, and maintain system prompts and instruction sets for AI agents focused on student enrollment, learning, and retention.
- Translate complex educational and operational requirements into clear, reliable agent behavior including persona, scope, and multi-turn logic.
- Design prompt architectures for multi-step and chained agent workflows, including RAG-augmented agents.
- Build and maintain evaluation frameworks to monitor agent accuracy, tone, and hallucination rates.
- Perform red-teaming and adversarial testing to identify failure modes before student deployment.
- Collaborate with internal teams and university stakeholders to translate learning objectives into effective prompt instructions.
- Contribute to best practices documentation for internal teams using the AI orchestration platform.
View Full Description & ApplyYou'll be redirected to the employer's site
