Senior Software Engineer, AI - UpDoc

View full description

Requirements:

• 5+ years of professional software development experience, including 2+ years of experience with backend web development
• Experienced and comfortable working with type-hinted, modern Python
• 2+ years of experience building end-to-end LLM applications, personally or professionally
• Experience integrating/optimizing LLMs in production environments
• Knowledge of evaluation frameworks
• Knowledge and experience with MLOps/LLMOps best practices
• Experience building AI infrastructure from 0 -> 1
• Experience with cloud platforms (especially Azure) and containerization technologies

Responsibilities:

• Lead the development of our patient-facing conversational agent
• Implement a scalable, low-latency system for voice/multimodal conversations
• Implement rigorous prompt engineering processes and develop useful metrics for system evaluation
• Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation
• Work with other backend engineers to deploy AI models and chat/voice APIs
• Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks
• Collaborate with clinical experts to validate performance and medical accuracy
• Work on developing backend services using FastAPI and Pydantic