Lead Machine Learning Engineer

View full description

Requirements:

• MS/Ph.D. in computer science, mathematics, or another quantitative discipline or exceptional work experience in ML engineering.
• 5+ years ML Experience.
• Experience developing machine learning-driven products at scale.
• Experience solving problems using Machine Learning with PyTorch.
• Exceptional understanding of designing ML systems in production at scale and applying a quantitative approach to identifying performance bottlenecks and cost/performance tradeoffs.
• Practical experience with large data systems, data models, and batch and streaming data pipelines.
• Ability to ramp up quickly on our tech stack, which includes GCP, Kubernetes, Airflow, Pandas, PyTorch, Python, and Node.js.
• Extensive experience with model deployment, both static within applications and dynamic, using Flask, FastAPI, or similar frameworks.

Responsibilities:

• Build and maintain a training pipeline for fine-tuning open-source LLMs.
• Serve and Deploy the LLM on GPUs. It is important to know different configurations ahead of time to ensure we don’t OOM at runtime.
• Formulate novel product issues to ML problems and propose and iterate on solutions quickly. We value the fast pace of development.
• Triage customer issues to model/system shortcomings and communicate the complex architecture in a simple, comprehensible way to internal stakeholders.
• Keep up with the fast-growing generative AI space and incorporate the latest developments into our system.