Member of Technical Staff, Reinforcement Learning

Inception; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Inception seeks experienced scientists and engineers with deep expertise in post-training large language models through reinforcement learning. You will design and implement RL training pipelines for diffusion LLMs, develop reward modeling strategies, and build the algorithms that align model behavior with human intent at scale.

The role focuses on designing RL training pipelines, building reward models, and advancing alignment techniques for enterprise-grade LLMs, with emphasis on stability,

Qualifications

• PhD or equivalent research/engineering experience in ML.
• Proficient with PyTorch and distributed training.
• Strong knowledge of transformers, LLMs, and RLHF workflows.

Responsibilities

• Design, develop, and optimize RL training pipelines (PPO, DPO, RLHF) for diffusion-based LLMs.
• Build and iterate reward models and evaluation of reward quality.
• Implement approaches for fine-tuning and scaling generative AI models.
• Work on data preprocessing, model evaluation, and enterprise alignment.
• Research techniques for controlled text generation and constraint satisfaction.
• Improve training stability, efficiency, and reproducibility of RL workloads.

Skills

RLHF experience

PPO/DPO familiarity

Transformer models

Distributed training

PyTorch experience

Education

BS/MS/PhD in CS

Tools

vLLM

TensorRT

SGLang

Job description

The Role

We seek experienced scientists and engineers with deep expertise in post-training large language models through reinforcement learning. You will design and implement RL training pipelines for our diffusion LLMs, develop reward modeling strategies, and build the algorithms that align model behavior with human intent at scale.

Key Responsibilities

• Design, develop, and optimize RL training pipelines (PPO, DPO, RLHF, and novel approaches) for diffusion-based LLMs.
• Build and iterate on reward models, reward shaping strategies, and evaluation of reward quality.
• Implement innovative approaches for fine-tuning and scaling generative AI models.
• Work on data preprocessing pipelines, model evaluation, and alignment to enterprise use cases.
• Research and implement techniques for controlled text generation and constraint satisfaction.
• Improve training stability, efficiency, and reproducibility of RL workloads.

Qualifications

• BS/MS/PhD in Computer Science or a related field (or equivalent experience).
• At least 2 years of experience working on ML projects in PyTorch (or equivalent), preferably in a research lab or engineering role.
• Excellent familiarity with transformers and core LLM concepts (autoregressive pretraining, instruction tuning, in-context learning, KV caching).
• Hands-on experience with reinforcement learning from human feedback (RLHF), PPO, DPO, or related post-training methods.
• Familiarity with training and inference in diffusion models.
• Experience training deep learning models at scale in distributed computing environments.

Preferred Skills

• Extensive experience training transformer-based language models from scratch.
• Experience designing and implementing reward models or preference learning systems.
• Knowledge of advanced training techniques (mixed precision, gradient accumulation, etc.).
• Background in optimization theory and neural network architecture design.
• Experience with LLM serving frameworks like vLLM, SGLang, or TensorRT.