Why is remote work so nice? Let's try to see!
Apply
Senior Research Engineer - Training Efficiency
Posted 22 days agoViewed
💎 Seniority level: Senior
🔍 Industry: Software Development
🏢 Company: Luma AI👥 1-10💰 $43,000,000 Series B about 1 year agoVirtual RealityAugmented RealityArtificial Intelligence (AI)Computer VisionVideo Games3D Technology
Requirements:
- Experience training large models using Python & Pytorch, including practical experience working with the full development pipeline from data processing, preparation & dataloading to training and inference.
- Experience profiling GPU & CPU code in Pytorch for optimal device utilization (examples: torch profiler, NVIDIA Nsight systems/compute, memory profilers, trace viewers, custom tooling).
- Experience writing & improving highly parallel & distributed Pytorch code of large generative models, with familiarity in FSDP, Tensor Parallel, Sequence/Context Parallel, Pipeline Parallel etc.
- Experience working with transformer models and attention implementations.
Responsibilities:
- Ensure efficient implementation of models & systems with a focus on large-scale training.
- Identify and implement optimization techniques for massively parallel and distributed systems, including the underlying communication layer.
- Identify and remedy efficiency bottlenecks (memory, speed, utilization, communication) by profiling and implementing high-performance PyTorch code, deferring to Triton, CUDA, and lower levels as necessary.
- Work closely together with the rest of the research team to ensure systems are planned to be as efficient as possible from start to finish.
- Conduct research & experiments on state-of-the-art large-scale generative AI models with the goal to improve latency & throughput for training and inference.
Related Articles
Posted 7 months ago
Insights into the evolving landscape of remote work in 2024 reveal the importance of certifications and continuous learning. This article breaks down emerging trends, sought-after certifications, and provides practical solutions for enhancing your employability and expertise. What skills will be essential for remote job seekers, and how can you navigate this dynamic market to secure your dream role?
Posted 8 months ago
Explore the challenges and strategies of maintaining work-life balance while working remotely. Learn about unique aspects of remote work, associated challenges, historical context, and effective strategies to separate work and personal life.
Posted 8 months ago
Google is gearing up to expand its remote job listings, promising more opportunities across various departments and regions. Find out how this move can benefit job seekers and impact the market.
Posted 8 months ago
Learn about the importance of pre-onboarding preparation for remote employees, including checklist creation, documentation, tools and equipment setup, communication plans, and feedback strategies. Discover how proactive pre-onboarding can enhance job performance, increase retention rates, and foster a sense of belonging from day one.