Senior AI Engineer
New
P
PennylaneFintech
All France (remote), Portugal (remote), Germany (remote), France, Italy, Spain (remote), Madrid. You'll be able to work remotely from your country of residence, as long as it is in Europe and within a maximum time difference of two hours from the CET time zone., Within 2 hours of CETFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- 5–8 years
- Required Skills
- AWSPythonKubernetesMachine LearningLLM
Requirements
- 5–8 years of professional experience.
- Strong proficiency in Python.
- Hands-on experience building LLM and agentic systems at scale in production.
- Deep understanding of prompting, tool use, context construction, and RAG.
- Proven experience with agent failure handling, state management, and reliability engineering.
- Experience treating evaluation as a first-class discipline (golden datasets, LLM-as-judge, human eval, A/B testing).
- Solid grasp of applied LLM/ML and AI infrastructure (model serving, vector databases, cost and latency).
- Fluent in English.
- Ability to communicate effectively with technical and non-technical domain experts.
- Familiarity with Kubernetes and AWS preferred.
- Nice to have: Model fine-tuning (SFT, DPO, RL), MCP, and Ruby familiarity.
Responsibilities
- Build and harden agentic loops in production including LLM call orchestration, tool calling, and error recovery.
- Own context and memory engineering, balancing latency and cost trade-offs.
- Enable agent usage by turning business capabilities into documented and tested tools exposed internally and via MCP.
- Implement evaluation as a first-class discipline using golden datasets, LLM-as-judge, human evaluation, and regression tracking.
- Collaborate with Product teams and domain experts on live use cases like bookkeeping and document extraction.
- Monitor the AI landscape for emerging trends, SOTA models, and optimization techniques.
View Full Description & ApplyYou'll be redirected to the employer's site