AI Engineer

New

IsraelContractMiddle

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

5+ years of experience with Node.js and Next.js, building scalable backend systems and handling complex data flows
Strong experience in prompt engineering, especially dynamic and context-aware LLM prompting
Hands-on experience with LLM observability tools such as Langfuse or similar platforms
Experience using OpenRouter or unified LLM APIs, including model selection, rate limit handling, and cost optimization
Familiarity with evaluation frameworks such as RAGAS or custom LLM-as-a-judge systems
Strong analytical mindset with the ability to translate logs and model outputs into actionable insights
Experience with structured AI workflows, debugging, and iterative product improvement cycles
Experience with fine-tuning models, RAG architectures, and basic Python for AI/data tasks (nice to have)
Strong communication skills and a highly iterative, experiment-driven working style

Build, optimize, and scale LLM-driven systems, ensuring they are reliable, cost-efficient, and production-ready
Continuously improve model performance through structured experimentation and evaluation
Design advanced prompt engineering systems with dynamic logic, contextual injection, and reusable templates
Implement structured output frameworks (JSON schemas, function calling, Zod validation)
Build and maintain evaluation pipelines using tools like Langfuse
Conduct deep tracing and debugging of LLM chains to identify inefficiencies, optimize latency, and reduce operational costs
Run AI A/B testing across multiple models via platforms like OpenRouter
Develop scoring and analytics systems to evaluate reasoning chains, detect hallucinations, and improve output reliability
Reassess and fine-tune models as needed, ensuring continuous improvement aligned with evolving architectures and business needs

View Full Description & ApplyYou'll be redirected to the employer's site