Member of Technical Staff, Training Performance Engineer
New
C
CohereEnterprise AI
We have offices in London, Toronto, New York and San Francisco, but we’re also remote-friendly! This team operates primarily between ET to CET time zones, so we’re seeking candidates in locations that align with these hours for effective collaboration., ET to CETFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonPyTorchSoftware Engineering
Requirements
- Extremely strong software engineering skills.
- Proficiency in Python.
- Experience with ML frameworks such as JAX, PyTorch, and XLA/MLIR.
- Experience writing GPU kernels using CUDA, Triton, or similar technologies.
- Experience using large-scale distributed training strategies.
- Familiarity with autoregressive sequence models, such as Transformers.
Responsibilities
- Design and write high-performant and scalable software for training.
- Optimize language models to ensure high accelerator utilization and training throughput.
- Identify and remove performance bottlenecks within training systems.
- Write low-level CUDA and Triton kernels for hardware acceleration.
- Develop cutting-edge training and profiling tools.
- Research, implement, and experiment with ideas on supercompute and data infrastructure.
View Full Description & ApplyYou'll be redirected to the employer's site
