Member of Engineering (Pre-training)

Experience with Large Language Models (LLM). Deep knowledge of Transformers. Knowledge/Experience with cutting-edge training tricks. Knowledge/Experience of distributed training. Trained LLMs from scratch. Coded LLMs from scratch. Knowledge of deep learning fundamentals. Strong machine learning and engineering background. Research experience. Programming experience. Linux proficiency. Strong algorithmic skills. Python with PyTorch or Jax. C/C++, CUDA, Triton.

Follow the latest research on LLMs and source code generation. Propose and evaluate innovations in training quality and efficiency. Manage and analyze LLM experiments (LLM-Ops). Write high-quality Python, Cython, C/C++, Triton, CUDA code. Plan future steps and collaborate with the team.