Staff Scientist — Diffusion LLM Architect

Inception; San Francisco (CA); On-site; USD 180,000 - 230,000; Full time

Job summary

Inception seeks experienced scientists and engineers with deep expertise in pre-, mid-, and post-training large language models. You will advance diffusion-based LLM models, developing novel training techniques and pushing the boundaries of parallel token generation.

Key responsibilities include designing architectures for diffusion-based language models, implementing training objectives, and researching techniques for controlled text generation and multi-modal integration.

Qualifications

• BS/MS/PhD in CS (or equivalent).
• 2+ years ML experience in PyTorch, research or engineering setting.
• Excellent familiarity with transformers and core LLM concepts.
• Familiarity with training and inference in diffusion models.

Responsibilities

• Design, develop, and optimize architectures for diffusion-based language models.
• Implement training objectives and loss functions for discrete diffusion LLMs.
• Research techniques for controlled text generation and constraint satisfaction.
• Develop methods for multi-modal integration within the diffusion framework.
• Improve model efficiency, reduce training time, and optimize inference throughput.
• Develop post-training techniques to align and improve model behavior.

Skills

PyTorch

Transformers

Distributed computing

LLM concepts

Diffusion models

Education

BS/MS/PhD in CS

Tools

vLLM

TensorRT

SGLang

Job description

Inception seeks experienced scientists and engineers with deep expertise in pre-, mid-, and post-training large language models. You will advance diffusion-based LLM models, developing novel training techniques and pushing the boundaries of parallel token generation.

Key responsibilities include designing architectures for diffusion-based language models, implementing training objectives, and researching techniques for controlled text generation and multi-modal integration.