ML Systems Engineer, Model Architectures (Mid/Senior/Principal)
New
P
Positron AIAI inference hardware
United StatesFull-TimeSenior
Salary160,000 - 220,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of experience as an ML systems or inference engineer.
- Required Skills
- PythonPyTorchRust
Requirements
- Have 4+ years of experience as an ML systems or inference engineer.
- Understand transformer internals at the operator level, including attention variants, mixture-of-experts, embeddings, KV cache, and INT8 and FP8 quantization.
- Have experience implementing or porting model inference by hand in PyTorch, llama.cpp, vLLM, TensorRT-LLM, or a custom runtime.
- Have hands-on experience debugging numerical mismatches against a reference down to the operator and the bit.
- Be able to read a model architecture paper and turn it into a working, verified implementation.
- Have strong Rust skills, or expert-level C/C++ skills and willingness to work in Rust day to day.
- Have strong Python skills for model and reference work.
- Preferred: experience mapping models onto accelerator hardware or writing kernels for a non-GPU architecture.
- Preferred: prior experience serving as the technical point of contact for customer model requests.
Responsibilities
- Implement simulator operators, numerics, and memory layouts for new model architectures, matching a reference implementation bit-exactly.
- Extend simulator coverage across prefill and decode, embeddings, attention variants, mixture-of-experts routing, and quantized formats.
- Maintain reference comparisons and regression coverage as the simulator and hardware evolve.
- Evaluate architectures before hardware exists, identifying compute, memory, and data-movement requirements and potential chip changes.
- Bring customer models up in simulation before emulator and hardware runs, and own the turnaround time.
- Partner with the agentic tooling engineer to automate model bring-up from model specification through simulator coverage.
View Full Description & ApplyYou'll be redirected to the employer's site