Principal ML Solutions Architect - Token Factory

NebiusAI cloud infrastructure

You’re welcome to work remotely from the United States.Full-TimePrincipal

Salary208,000 - 261,000 USD per year

Apply NowOpens the employer's application page

Job Details

Experience: 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI
Required Skills: PythonKubernetesPrompt Engineering

Have 8+ years of experience in ML/AI systems, including at least 4 years focused on LLMs and generative AI.
Demonstrate technical leadership by owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers.
Bring expert knowledge of LLM model architectures, fine-tuning approaches, and inference internals.
Have hands-on command of inference optimization, including quantization, KV-cache management, batching, and routing.
Have experience deploying, operating, and debugging LLM inference workloads at scale down to the framework level.
Have LLM fine-tuning experience, including SFT/LoRA, data preparation and curation, and RL-based fine-tuning.
Have experience building task-specific LLM benchmarks and offline/online evaluation pipelines, including LLM-as-a-judge setups.
Have experience with vLLM, SGLang, or TensorRT-LLM, including reading, modifying, and contributing to framework internals.
Have experience deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models.
Have strong Python programming skills.

Own complex customer engagements from architecture through production across multiple modalities.
Optimize LLM inference at the framework and hardware level and codify best practices into reusable team playbooks.
Lead supervised and reinforcement fine-tuning efforts to maximize model quality.
Design and implement production-ready LLM solutions using Token Factory inference services.
Provide technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs.
Partner with product, engineering, and research teams to surface customer needs, prototype platform features, and influence the roadmap.
Guide customers from proof of concept to production, focusing on performance, reliability, and cost efficiency.
Define team standards for moving customer solutions into production.
Mentor Senior and mid-level Solutions Architects through review, enablement, and knowledge sharing.
Represent Token Factory through talks, blog posts, and conferences.

View Full Description & ApplyYou'll be redirected to the employer's site