Member of Technical Staff - Image / Video Applications

Black Forest Labs; Freiburg im Breisgau; Vor Ort; EUR 65.000 - 85.000; Vollzeit

Zusammenfassung

A leading deep learning research company in Freiburg im Breisgau is seeking an Applied Researcher to innovate control mechanisms for image and video generation models. The role involves training large-scale Diffusion models and developing practical production features. Candidates should have extensive experience with Diffusion models and strong proficiency in PyTorch. This position offers an opportunity to work with pioneering technology in generative AI, contributing to advancements in the field.

Qualifikationen

• Experience training large scale Diffusion models for image and video data.
• Finetuning Diffusion models for image and video applications.
• Strong proficiency in PyTorch and transformer models.

Aufgaben

• Training large-scale Diffusion models with advanced control mechanisms.
• Developing conditioning mechanisms for production requirements.
• Communicating design choices and results with the team.

Kenntnisse

Training large scale Diffusion models

Finetuning Diffusion models

Deep understanding of generative models

Proficiency in PyTorch

FSDP and low precision training techniques

Jobbeschreibung

At Black Forest Labs, we’re on a mission to advance the state of the art in generative deep learning for media, building powerful, creative, and open models that push what’s possible.

Born from foundational research, we continuously create advanced infrastructure to transform ideas into images and videos.

Our team pioneered Latent Diffusion, Stable Diffusion, and FLUX.1 – milestones in the evolution of generative AI. Today, these foundations power millions of creations worldwide, from individual artists to enterprise applications.

We are looking for an Applied Researcher to develop precise control mechanisms for our image and video generation models, enabling users to direct outputs through practical controls like color palettes, transparency channels, and other production-ready features

Role and Responsibilities

• Training large-scale Diffusion (transformer) models with advanced control mechanisms (hex color control, transparency generation, custom aspect ratios, etc.)
• Developing conditioning mechanisms for practical production requirements in image and video generation
• Rigorously ablating design choices for applied controls and communicating results & decisions with the broader team
• Reasoning about the speed and quality trade-offs of control architectures for real-world applications

What we look for:

• Experience training large scale Diffusion models for image and video data
• Finetuning Diffusion models for image and video applications, such as, image and video upscalers, in and out painting models, etc.
• Deep understanding of how to effectively evaluating image and video generative models
• Strong proficiency in PyTorch, transformer models and other NN architectures.
  
• Deep understanding of training techniques such as FSDP, low precision training, and model parallelism

Nice to have:

• Experience with writing forward and backward Triton kernels and ensuring their correctness while considering floating point errors
• Profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight or stack trace viewers