Member of Technical Staff - Pretraining
New
B
Black Forest LabsGenerative AI Research
Depending on your role, you’ll either join us in Freiburg or SF at least 2 days a week (or one full week every other week), or work remotely with a monthly in-person week to stay connected.Full-TimeSenior
Salary€130,000-€340,000 + Equity
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonPyTorchGenerative AI
Requirements
- Led or co-owned pretraining for a foundation model that shipped to production or a major release.
- Experience making architectural calls on attention patterns, modulation schemes, loss formulations, and tokenization strategies.
- Deep experience with large-scale distributed training (FSDP, TP, PP) on 500+ GPUs.
- Ability to debug loss spikes, NaNs, throughput regressions, and silent correctness issues at scale.
- Track record of top-venue publications (NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or unambiguous production wins.
- Deep Python and PyTorch proficiency.
- Familiarity with visual generative models.
Responsibilities
- Lead large-scale pretraining experiments for multimodal (image, video, audio) foundation models.
- Develop and evaluate novel ideas across architecture, optimizers, and training algorithms.
- Contribute across the full stack including low-level GPU and systems optimizations, research code, and high-level model design.
- Lead focused research projects independently and drive larger cross-team initiatives.
View Full Description & ApplyYou'll be redirected to the employer's site
