Member of Technical Staff - Pretraining
New
B
Black Forest LabsGenerative AI
Depending on your role, you’ll either join us in Freiburg or SF at least 2 days a week (or one full week every other week), or work remotely with a monthly in-person weekFull-TimeStaff
Salary€130,000-€340,000 + Equity
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonMachine LearningPyTorch
Requirements
- Proven experience leading or co-owning pretraining for a foundation model (image, video, LLM, or multimodal) that shipped to production or a major release.
- Ability to own architectural calls such as attention patterns, modulation schemes, loss formulations, and tokenization strategies.
- Deep experience with large-scale distributed training, including FSDP/TP/PP, multi-node runs at 500+ GPUs, and debugging training issues at scale.
- Strong intuition for architecture and objective design.
- Track record of shipping, including top-venue publications (NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or production impact at a frontier lab.
- Deep Python and PyTorch proficiency.
- Familiarity with visual generative models.
Responsibilities
- Lead large-scale pretraining experiments for our multimodal (image, video, audio) foundation models (architecture, objective functions, scaling strategies)
- Develop and evaluate novel ideas across architecture, optimizers, and training algorithms.
- Contribute across the full stack: low-level GPU and systems optimizations, research code, and high-level model design
- Lead focused research projects independently and drive larger cross-team initiatives
View Full Description & ApplyYou'll be redirected to the employer's site
