Senior Software Engineer II - AI Engineering
New
S
SmartsheetSoftware, AI
REMOTE, USAFull-TimeSenior
Salary$175,000 — $245,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
- Required Skills
- AWSPythonGCPAzureDatabricksPrompt EngineeringLLMMLOps
Requirements
- 8+ years of software engineering experience
- At least 2 years working directly with LLMs in production
- Deep, hands-on experience with prompt engineering and context engineering
- Strong working knowledge of RAG architectures including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis
- Experience building or extending LLM evaluation frameworks
- Fluency in agent system design
- Strong Python skills
- Comfortable working in data-heavy environments (Databricks, Delta tables, or equivalent)
- Ability to communicate complex quality findings to technical and non-technical stakeholders
- Strong cross-functional judgment
- BS or MS in Computer Science, a related field, or equivalent industry experience
Responsibilities
- Design and build production-grade LLM-powered agents and workflows within Smartsheet, including architecture decisions on system design, data pipelines, and deployment strategies
- Develop and optimize prompts, RAG pipelines, and agent reasoning patterns; build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions
- Implement and manage end-to-end AI systems on cloud infrastructure (AWS, GCP, or Azure), including monitoring, optimization, and incident response
- Collaborate with Engineering, Product, and cross-functional teams to translate business requirements into technical AI solutions that drive real impact
- Mentor and guide other engineers on applied ML best practices, modern AI development patterns, and production considerations
- Establish best practices and standards for AI development, model governance, and responsible AI within the organization
- Stay current with the rapidly evolving AI/LLM landscape and evaluate emerging tools, frameworks, and techniques for Smartsheet's needs
View Full Description & ApplyYou'll be redirected to the employer's site
