Member of Technical Staff - 3D

Black Forest Labs; Freiburg im Breisgau; Vor Ort; EUR 40.000 - 60.000; Vollzeit

Zusammenfassung

A leading technology research firm in Freiburg im Breisgau is seeking a 3D Researcher to enhance image and video generation models through advanced camera control techniques. Candidates should have experience in training large-scale Diffusion models, a strong grasp of 3D projective geometry, and proficiency in PyTorch. Ideal applicants will communicate effectively with multidisciplinary teams and contribute to cutting-edge generative AI projects. This role provides an opportunity to work on transformative technologies at the forefront of AI innovation.

Qualifikationen

• Experience training large-scale Diffusion models for image and video data.
• Strong understanding of 3D projective geometry and camera models.
• Proficiency in integrating geometric priors into neural networks.

Aufgaben

• Training large-scale Diffusion models for camera-controllable image generations.
• Developing conditioning mechanisms for 3D camera parameters.
• Communicating results and decisions regarding 3D control design.

Kenntnisse

Experience training large-scale Diffusion models

Strong understanding of 3D projective geometry

Experience with 3D-aware generative models

Strong proficiency in PyTorch

Understanding of training techniques

Jobbeschreibung

At Black Forest Labs, we’re on a mission to advance the state of the art in generative deep learning for media, building powerful, creative, and open models that push what’s possible.

Born from foundational research, we continuously create advanced infrastructure to transform ideas into images and videos. Our team pioneered Latent Diffusion, Stable Diffusion, and FLUX.1 – milestones in the evolution of generative AI.

Today, these foundations power millions of creations worldwide, from individual artists to enterprise applications.

We are looking for a 3D Researcher to bring precise camera control to our image and video generation models.

Role and Responsibilities

• Training large-scale Diffusion (transformer) models for camera-controllable image and video generation
• Developing conditioning mechanisms for 3D camera parameters (poses, trajectories, intrinsics) in diffusion models
• Rigorously ablating design choices for 3D control and communicating results & decisions with the broader team
• Reasoning about the speed and quality trade-offs of 3D-aware architectures

What we look for

• Experience training large-scale Diffusion models for image and video data
• Strong understanding of 3D projective geometry, camera models, and coordinate systems
• Experience with 3D-aware generative models or neural rendering techniques (NeRFs, 3DGS, etc.)
• Integrating geometric priors and 3D conditioning into neural networks
• Strong proficiency in PyTorch, transformer models and other NN architectures
• Deep understanding of training techniques such as FSDP, low precision training, and model parallelism

Nice to have:

• Experience with multi-view consistency in generative models
• Understanding of camera calibration, structure-from-motion, or SLAM