Senior GenAI Python Engineer, GenAI Safety and Quality

View full description

Requirements:

• 5+ years of systems software engineering
• Strong proficiency in Python programming with frameworks and best practices, plus strong problem-solving skills and understanding of data structures and system design
• Experience with version control (Git) and GitHub CI/CD pipelines, demonstrating ability to maintain and deploy code effectively
• Experience with Azure Cloud platform and its key services
• Hands-on experience developing and deploying Generative AI applications, including integration with LLM APIs and vector databases, with demonstrated ability to stay current with latest advancements in fine-tuning, RLHF, RAG, and prompt engineering frameworks (such as LangChain and LangGraph)
• Experience with Responsible AI practices and LLM evaluation tools such as DeepEval and Giskard
• Excellent communication and documentation skills, including ability to explain technical concepts to non-technical stakeholders, create clear API specifications, implementation guides, system architecture documentation, and collaborate effectively in a global team with minimal supervision

Responsibilities:

• Design and build cloud-native web applications with a focus on scalability and performance, particularly for AI safety and quality assessment and monitoring
• Write and maintain comprehensive test suites for our team’s safety and quality assessment platforms, perform thorough system integration testing, and ensure high-quality deployments of our tools
• Work closely with business analysts, product managers, and development teams across the organization
• Manage code using GitHub Workflows and Actions, and implement automated CI/CD pipelines for efficient deployments
• Monitor and communicate project risks, progress, and key metrics to stakeholders