Member of Technical Staff - Image / Video Applications

Black Forest Labs Inc.; Freiburg im Breisgau; Vor Ort; EUR 65.000 - 85.000; Vollzeit

Zusammenfassung

A technology company specializing in generative AI is seeking an Applied Researcher to enhance image and video generation models through precise control mechanisms like color palettes and transparency channels. Candidates should have experience training large-scale models and a strong command of PyTorch. This role is based in Freiburg, Germany.

Qualifikationen

• Experience training large-scale diffusion models for image and video data.
• Deep understanding of how to evaluate image and video generative models effectively.
• Strong proficiency in PyTorch, transformer models, and other neural network architectures.

Aufgaben

• Training large-scale diffusion models with advanced control mechanisms.
• Developing conditioning mechanisms for practical production requirements.
• Conducting rigorous ablation studies and communicating results.

Kenntnisse

Experience training large-scale diffusion models

Finetuning diffusion models

Strong proficiency in PyTorch

Deep understanding of training techniques

Jobbeschreibung

Member of Technical Staff - Image / Video Applications

At Black Forest Labs, we’re on a mission to advance the state of the art in generative deep learning for media, building powerful, creative, and open models that push what’s possible.

Born from foundational research, we continuously create advanced infrastructure to transform ideas into images and videos.

Our team pioneered Latent Diffusion, Stable Diffusion, and FLUX.1 – milestones in the evolution of generative AI. Today, these foundations power millions of creations worldwide, from individual artists to enterprise applications.

We are looking for an Applied Researcher to develop precise control mechanisms for our image and video generation models, enabling users to direct outputs through practical controls like color palettes, transparency channels, and other production‑ready features.

Role and Responsibilities

• Training large‑scale diffusion models with advanced control mechanisms (hex color control, transparency generation, custom aspect ratios, etc.)
• Developing conditioning mechanisms for practical production requirements in image and video generation
• Rigorously ablation studies of design choices for applied controls and communicating results & decisions with the broader team
• Reasoning about the speed and quality trade‑offs of control architectures for real‑world applications

What we look for:

• Experience training large‑scale diffusion models for image and video data
• Finetuning diffusion models for image and video applications such as image and video upscalers, in‑painting, out‑painting models, etc.
• Deep understanding of how to evaluate image and video generative models effectively
• Strong proficiency in PyTorch, transformer models and other neural network architectures
• Deep understanding of training techniques such as FSDP, low‑precision training, and model parallelism

Nice to have:

• Experience with writing forward and backward Triton kernels and ensuring their correctness while considering floating‑point errors
• Profiling, debugging, and optimizing single and multi‑GPU operations using tools such as Nsight or stack‑trace viewers

As set forth in Black Forest Labs’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.