Member of Technical Staff - 3D

Black Forest Labs Inc.; Freiburg im Breisgau; Vor Ort; EUR 65.000 - 80.000; Vollzeit

Zusammenfassung

An innovative AI research company in Freiburg im Breisgau is seeking a 3D Researcher to enhance the capabilities of image and video generation models. The role involves training large-scale Diffusion models and developing effective conditioning mechanisms for 3D camera parameters. Candidates should have strong expertise in 3D projective geometry and proficient experience in PyTorch. This position offers a unique opportunity to contribute to cutting-edge generative AI projects.

Qualifikationen

• Experience training large-scale Diffusion models for image and video data.
• Strong understanding of 3D projective geometry, camera models, and coordinate systems.
• Experience with 3D-aware generative models or neural rendering techniques.

Aufgaben

• Training large-scale Diffusion models for camera-controllable image and video generation.
• Developing conditioning mechanisms for 3D camera parameters in diffusion models.
• Communicating results and decisions with the broader team.

Kenntnisse

Experience training large-scale Diffusion models for image and video data

Strong understanding of 3D projective geometry

Experience with 3D-aware generative models

Strong proficiency in PyTorch

Deep understanding of training techniques

Jobbeschreibung

At Black Forest Labs, we’re on a mission to advance the state of the art in generative deep learning for media, building powerful, creative, and open models that push what’s possible.

Born from foundational research, we continuously create advanced infrastructure to transform ideas into images and videos. Our team pioneered Latent Diffusion, Stable Diffusion, and FLUX.1 – milestones in the evolution of generative AI.

Today, these foundations power millions of creations worldwide, from individual artists to enterprise applications.

We are looking for a 3D Researcher to bring precise camera control to our image and video generation models.

Role and Responsibilities

• Training large-scale Diffusion (transformer) models for camera-controllable image and video generation
• Developing conditioning mechanisms for 3D camera parameters (poses, trajectories, intrinsics) in diffusion models
• Rigorously ablating design choices for 3D control and communicating results & decisions with the broader team
• Reasoning about the speed and quality trade-offs of 3D-aware architectures

What we look for

• Experience training large-scale Diffusion models for image and video data
• Strong understanding of 3D projective geometry, camera models, and coordinate systems
• Experience with 3D-aware generative models or neural rendering techniques (NeRFs, 3DGS, etc.)
• Integrating geometric priors and 3D conditioning into neural networks
• Strong proficiency in PyTorch, transformer models and other NN architectures
• Deep understanding of training techniques such as FSDP, low precision training, and model parallelism

Nice to have

• Experience with multi-view consistency in generative models
• Understanding of camera calibration, structure-from-motion, or SLAM