Sr. Software Engineer II - AI Engineering
New
S
SmartsheetAI-powered SaaS
REMOTE, USAFull-TimeSenior
Salary$175,000 — $245,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
- Required Skills
- PythonMachine LearningDatabricksPrompt EngineeringLLM
Requirements
- 8+ years of software engineering experience.
- 2+ years of experience working directly with LLMs in production.
- Deep, hands-on experience with prompt engineering and context engineering.
- Strong working knowledge of RAG architectures, including chunking strategies, embedding models, and retrieval evaluation.
- Experience building or extending LLM evaluation frameworks.
- Fluency in agent system design and architectural tradeoffs.
- Strong Python skills and comfort in data-heavy environments (Databricks, Delta tables, or equivalent).
- Strong communication skills for explaining complex technical findings to diverse stakeholders.
- Strong cross-functional judgment and ability to work in ambiguous situations.
- BS or MS in Computer Science, a related field, or equivalent industry experience.
Responsibilities
- Design and build production-grade LLM-powered agents and workflows, including architecture, data pipelines, and deployment strategies.
- Develop and optimize prompts, RAG pipelines, and agent reasoning patterns.
- Build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions.
- Implement and manage end-to-end AI systems on cloud infrastructure (AWS, GCP, or Azure), including monitoring and incident response.
- Collaborate with cross-functional teams to translate business requirements into technical AI solutions.
- Mentor other engineers on applied ML best practices, modern AI patterns, and production considerations.
- Establish best practices for AI development, model governance, and responsible AI.
- Evaluate emerging tools, frameworks, and techniques for AI/LLM development.
View Full Description & ApplyYou'll be redirected to the employer's site
