Senior Research Engineer
New
A
AssemblyAIVoice AI
Location: Remote - New YorkFull-TimeSenior
Salary270,000 - 310,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonMachine Learning
Requirements
- Expert-level proficiency with JAX and TPUs, including Flax, Optax, and the XLA compilation pipeline.
- Strong experience optimizing inference systems for production, ideally with LLMs or speech models.
- Deep understanding of distributed training at scale and modern deep learning systems.
- Proven measurement discipline: defining success metrics and validating results skeptically.
- Familiarity with modern inference optimization techniques such as continuous batching, KV-cache management, sharding, and quantization.
- Strong Python programming skills.
- Experience with C++ or Rust for kernel-level work is a plus.
- Ability to work effectively across the entire pipeline, from data to infrastructure to research.
- Excellent communication and a collaborative, cross-functional mindset.
Responsibilities
- Raise experimental velocity by improving the speed of launching experiments and interpreting results.
- Maintain and evolve the JAX training framework for scalable, efficient distributed training on TPUs.
- Improve training data quality by investigating issues, building diagnostic tooling, and driving accuracy gains.
- Analyze production model accuracy and develop evaluation harnesses to guide development priorities.
- Refactor and modernize research prototypes into production-ready systems.
- Optimize production inference architectures for speech language models using techniques like quantization and speculative decoding.
- Investigate and resolve performance bottlenecks from low-level kernels to high-level system design.
- Collaborate across research, infrastructure, and production engineering to trace and resolve complex problems.
View Full Description & ApplyYou'll be redirected to the employer's site
