AI Solutions Architect
New
T
TestlioSoftware Testing
Remote in AMER; This is a 100% remote role open to those who reside in the United States.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Machine LearningSoftware EngineeringNLP
Requirements
- Extensive practical experience developing, training, or fine-tuning machine learning models, NLP structures, or data pipelines.
- Deep familiarity and hands-on experience with modern LLM evaluation frameworks (e.g., DeepEval, RAGAs).
- Direct experience working with, deploying, or testing autonomous agent architectures (e.g., LangGraph, AutoGen, CrewAI).
- Strong software engineering foundations with experience in non-deterministic and deterministic systems.
- Proven client-facing track record leading discovery calls, stakeholder workshops, and consulting on enterprise architectures.
- Experience designing service offerings, understanding pricing dynamics, and formulating go-to-market strategies.
- Exceptional ability to bridge technical data science outputs with strategic business value.
- High adaptability to navigate fast-evolving and ambiguous AI application lifecycles.
- Strong passion for documentation and mentorship to uplift internal teams.
Responsibilities
- Define and maintain the AI service catalog, offerings, tiers, and delivery methodology.
- Produce white papers, articles, and webinars to evangelize the future of AI testing.
- Collaborate with sales and engagement teams to support pre-deal discovery and scoping.
- Conduct system-level breakdowns of client AI stacks including autonomous agents and RAG architectures.
- Act as a technical subject-matter expert and escalation point during complex client engagements.
- Advance the proprietary AI testing framework using human-in-the-loop and automated validation.
- Develop internal templates, training datasets, and documentation for test execution.
View Full Description & ApplyYou'll be redirected to the employer's site
