Lead Principal Scientist, Real-Time Multimodal AI

Amazon; Seattle (WA); On-site; USD 199,000 - 269,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Job summary

Amazon seeks a Principal Applied Scientist to lead real-time multimodal conversational AI research from pre-training to real-time deployment. You will design scalable models for speech, text, and audio, and develop post-training methods to ensure natural, responsive conversations at scale.

The role requires a PhD and 10+ years in the field, with experience training large foundation models and leading research teams toward production-ready solutions.

Qualifications

• PhD in Electrical Engineering, Computer Science, Mathematics or related field.
• 10+ years of industrial or academic work building speech recognition and NLP systems.
• Hands-on experience training large-scale foundation models.

Responsibilities

• Build and train large-scale multimodal foundation models for real-time speech and audio generation.
• Advance scaling and efficiency of conversational modes with real-time performance.
• Design architectures considering hardware constraints and production deployment.
• Develop post-training methods: reward modeling and RL alignment for real-time outputs.
• Ship research to production at scale with real users.

Skills

PhD in EE/CS/math

10+ years experience

foundation models

multimodal architectures

transformer architectures

research leadership

Education

PhD in Electrical Engineering, Computer Science, Mathematics

Tools

Large-scale training

RL/ RLHF

Job description

Amazon seeks a Principal Applied Scientist to lead real-time multimodal conversational AI research from pre-training to real-time deployment. You will design scalable models for speech, text, and audio, and develop post-training methods to ensure natural, responsive conversations at scale.

The role requires a PhD and 10+ years in the field, with experience training large foundation models and leading research teams toward production-ready solutions.