Member of Technical Staff — RL Research (Experienced)

Nuance Labs; Seattle (WA); On-site; USD 300,000 - 500,000; Full time

Benefits offered by this job

Health Savings Account plan

15 days PTO plus holidays

Lunch and snacks provided

Job summary

Nuance Labs in Seattle is looking for a deeply technical Member of Technical Staff to own reinforcement learning and post-training for large models. This role requires significant experience in RL and post-training methods, ensuring the development of systems that achieve real-time, multimodal interaction.

The candidate will build and optimize training systems, implementing modern methods and aligning research with production needs. A focus on interaction quality and feedback loops for omni behavior is crucial.

Compensation ranges from $300,000 to $500,000 base salary, with equity and other benefits.

Qualifications

• Significant hands-on experience with RL, RLHF, or large-scale fine-tuning for models.
• Deep understanding of RL/post-training methods and evaluation.
• Track record of reasoning about model behavior and training dynamics.

Responsibilities

• Build Nuance's RL/post-training stack from 0→1.
• Develop and scale post-training methods such as PPO and RLHF.
• Optimize the end-to-end post-training loop for real-time interaction.

Skills

Reinforcement Learning (RL)

Post-training methods

Policy optimization

Reward modeling

Software engineering fundamentals

Tools

OpenRLHF

vLLM

Job description

Seattle, Washington

About Nuance Labs

Nuance Labs is building photorealistic, real-time AI avatars with emotional intelligence: a full-duplex audiovisual system that can listen, speak, react, interrupt, and respond like a real person.

We're a research company, with PhDs from MIT, UW, Oxford, CMU, and Johns Hopkins, and industry experience from Apple, Meta, Amazon AGI, and Discord. The team is small, the work is real, and the problems are unsolved.

How Nuance Differentiates

Most conversational AI avatars today are hacks — a face slapped on a speech‑to‑speech pipeline, stuck in the uncanny valley: emotionless, mechanical, one‑turn‑at‑a‑time. Current systems take 2–5 seconds to respond; natural conversation requires sub‑500ms. That's a 10x improvement, and it demands rethinking the entire stack.

That rethinking starts with full‑duplex: an AI that listens and speaks simultaneously, perceives emotion in real time, and responds with a face that actually reflects it. It's an extremely hard problem, and we're developing foundation models designed for it from the ground up.

About the Role

We’re looking for a deeply technical Member of Technical Staff to own RL and post‑training for large‑scale omni models. This posting is aimed at experienced researchers and engineers who’ve operated at a senior to senior‑staff level at big tech or a leading research lab. Everyone at Nuance is MTS — we don’t run title ladders — but we’re hiring people who have already done this work at scale.

This role is broader than a traditional RL algorithm role. You will be expected to understand modern post‑training methods and build the infrastructure needed to run them at scale. The work spans RL method development, rollout generation, reward modeling, policy optimization, evaluation, data feedback loops, serving, observability, and distributed execution.

You will build Nuance’s RL/post‑training stack from 0→1 and scale it from 1→10. That means turning rapidly evolving research ideas into reliable training systems: defining the abstractions, choosing or modifying frameworks, wiring together rollout workers and trainers, building reward/evaluation loops, debugging failure modes, and making the system fast enough for researchers to iterate.

For Nuance, post‑training is not limited to text. Our models are omni from the ground up: audio, video, language, and real‑time full‑duplex interaction. We need RL and post‑training methods that improve interactive behavior, timing, interruption, emotional response, audiovisual coherence, and real‑time conversational quality.

This is a high‑ownership role with direct impact on how Nuance models improve after pretraining.

What You’ll Own

• Build Nuance’s RL/post‑training stack from 0→1: rollout generation, policy optimization, reward/reference model serving, data feedback loops, evaluation, checkpointing, observability, and debugging.
• Develop and scale post‑training methods such as PPO, GRPO, DPO, rejection sampling, RLHF/RLAIF, online RL, and model‑based data improvement.
• Design the systems abstractions that connect research ideas to production‑scale RL runs: trainers, rollout workers, reward models, evaluators, data queues, experience buffers, and checkpoint promotion.
• Build evaluation and feedback loops for omni behavior: turn‑taking, interruption, timing, emotional response, audiovisual coherence, instruction following, and real‑time interaction quality.
• Optimize the end‑to‑end post‑training loop across rollout throughput, serving latency, GPU utilization, policy update efficiency, queueing, checkpoint overhead, and research iteration speed.
• Evolve the platform as algorithms, model architectures, reward definitions, data sources, and evaluation methods change.

What We’re Looking For

• Significant hands‑on experience with RL, RLHF, RLAIF, post‑training, alignment, or large‑scale fine‑tuning for modern foundation models.
• Deep understanding of RL/post‑training methods: policy optimization, reward modeling, preference optimization, rejection sampling, KL control, evaluation, and data feedback loops.
• A track record reasoning about model behavior and training dynamics: reward hacking, unstable rewards, distribution shift, stale policies, mode collapse, over‑optimization, noisy preferences, and evaluation mismatch.
• Proven experience building or operating RL/post‑training pipelines at scale with frameworks such as verl, ms‑swift, OpenRLHF, or equivalent internal systems, including integration with rollout serving systems such as vLLM.
• Experience with large‑scale training or inference systems, including rollout generation, model serving, batching, queueing, GPU utilization, checkpointing, and debugging.
• Understanding of omni post‑training for real‑time audio‑video‑language interaction: temporal alignment, interruption, emotional response, and multimodal evaluation.
• Strong software engineering fundamentals, curiosity, and adaptability to new RL algorithms, model architectures, serving systems, evaluation methods, and research ideas.

Bonus Points

• Prior 0→1 experience building post‑training systems, RL pipelines, agent training systems, evaluation platforms, or large‑scale model improvement loops.
• Experience with PPO, GRPO, DPO, online RL, RLHF/RLAIF, reward modeling, preference data, synthetic data generation, or model‑based data improvement.
• Experience with omni or multimodal post‑training for audio‑video‑language models, especially long‑context or real‑time interactive systems.
• Experience scaling mixed training/inference workloads across large GPU clusters.
• Experience with adjacent areas such as distributed pretraining, data infrastructure, inference serving, simulation, human/AI feedback collection, or evaluation infrastructure.
• Publications or substantial open‑source contributions in RL, post‑training, alignment, evaluation, ML systems, or model behavior.

Compensation

$300,000 – $500,000 base salary, plus meaningful equity. We think long‑term ownership matters and structure equity accordingly.

Logistics

• Location: In‑person in Seattle, five days a week — we believe in the compounding value of working shoulder‑to‑shoulder.
• Visa sponsorship: We sponsor visas (O-1, H-1B, green card) from day one.
• AI-native tooling: Do your best work with the best tools, including unlimited tokens.
• Health: HSA plan with ~$2,000 in annual company contributions — roughly 2x what most big tech companies put in.
• Time off: 15 days of PTO plus public holidays, and we close the office for a full week at year‑end.
• Food: Lunch, drinks, and snacks on us every workday — the small thing that quietly makes the day better.
• Commuter benefits: We help cover the cost of getting to the office.
• 401(k): In the works.

Nuance Labs is an equal opportunity employer. We believe diverse teams build better AI.