Sr. Software Engineer II - AI Engineering

New
S
SmartsheetAI / Software Engineering
Teleworking options from any registered location in the U.S.Full-TimeSenior
Salary$175,000 - $245,000 USD
Apply NowOpens the employer's application page

Job Details

Experience
8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
Required Skills
AWSPythonGCPMachine LearningAzureDatabricksPrompt EngineeringLLM

Requirements

  • 8+ years of software engineering experience.
  • At least 2 years working directly with LLMs in production.
  • Deep, hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures including chunking strategies and embedding models.
  • Experience building or extending LLM evaluation frameworks.
  • Fluency in agent system design and architectural tradeoffs.
  • Strong Python skills and experience in data-heavy environments (Databricks, Delta tables, or equivalent).
  • Excellent written and verbal communication skills for technical and non-technical stakeholders.
  • Strong cross-functional judgment and ability to work in ambiguous situations.
  • BS or MS in Computer Science, a related field, or equivalent industry experience.

Responsibilities

  • Design and build production-grade LLM-powered agents and workflows, including architecture, data pipelines, and deployment strategies.
  • Develop and optimize prompts, RAG pipelines, and agent reasoning patterns.
  • Build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions.
  • Implement and manage end-to-end AI systems on cloud infrastructure (AWS, GCP, or Azure).
  • Collaborate with Engineering, Product, and cross-functional teams to translate business requirements into technical AI solutions.
  • Mentor and guide other engineers on applied ML best practices and production considerations.
  • Establish best practices and standards for AI development, model governance, and responsible AI.
  • Contribute to full stack application development across legacy and greenfield codebases.
View Full Description & ApplyYou'll be redirected to the employer's site
$175,000 - $245,000 USD
Apply Now