AI Platform Engineer

4+ years of software engineering experience with production systems Strong proficiency in Python Hands-on experience with LLM application frameworks (LangChain, LlamaIndex, Semantic Kernel, or DSPy) Proven experience building agent workflows and orchestrating multi-step AI processes Deep understanding of foundation model APIs (OpenAI, Anthropic, Google AI, AWS Bedrock, Azure OpenAI, or open-source models) Experience with prompt engineering (few-shot learning, chain-of-thought, prompt chaining) Hands-on experience implementing RAG systems with vector databases Experience building autonomous and semi-autonomous agent systems Implementing tool-calling and function-calling patterns with LLMs Creating agent memory systems Orchestrating multi-agent systems or agent handoffs Experience with agent evaluation, debugging, and observability Managing different foundation models for specific tasks Implementing streaming responses and real-time user interactions Handling context window management and conversation pruning strategies Building fallback and error recovery mechanisms for AI systems Cost optimization and rate limit management across multiple model providers

Design and build core AI platform services Develop and maintain retrieval-augmented generation (RAG) and semantic search pipelines Integrate foundation models into scalable microservices and APIs Create and manage prompt orchestration and versioning frameworks Develop evaluation, monitoring, and observability systems Optimize inference performance, latency, and cost Collaborate with product teams to enable new AI capabilities Stay current with LLM advancements