ML Systems Engineer, Model Architectures (Mid/Senior/Principal)

New
P
Positron AIAI inference hardware
United StatesFull-TimeSenior
Salary160,000 - 220,000 USD per year
Apply NowOpens the employer's application page

Job Details

Experience
4+ years of experience as an ML systems or inference engineer.
Required Skills
PythonPyTorchRust

Requirements

  • Have 4+ years of experience as an ML systems or inference engineer.
  • Understand transformer internals at the operator level, including attention variants, mixture-of-experts, embeddings, KV cache, and INT8 and FP8 quantization.
  • Have experience implementing or porting model inference by hand in PyTorch, llama.cpp, vLLM, TensorRT-LLM, or a custom runtime.
  • Have hands-on experience debugging numerical mismatches against a reference down to the operator and the bit.
  • Be able to read a model architecture paper and turn it into a working, verified implementation.
  • Have strong Rust skills, or expert-level C/C++ skills and willingness to work in Rust day to day.
  • Have strong Python skills for model and reference work.
  • Preferred: experience mapping models onto accelerator hardware or writing kernels for a non-GPU architecture.
  • Preferred: prior experience serving as the technical point of contact for customer model requests.

Responsibilities

  • Implement simulator operators, numerics, and memory layouts for new model architectures, matching a reference implementation bit-exactly.
  • Extend simulator coverage across prefill and decode, embeddings, attention variants, mixture-of-experts routing, and quantized formats.
  • Maintain reference comparisons and regression coverage as the simulator and hardware evolve.
  • Evaluate architectures before hardware exists, identifying compute, memory, and data-movement requirements and potential chip changes.
  • Bring customer models up in simulation before emulator and hardware runs, and own the turnaround time.
  • Partner with the agentic tooling engineer to automate model bring-up from model specification through simulator coverage.
View Full Description & ApplyYou'll be redirected to the employer's site
160,000 - 220,000 USD per year
Apply Now