Principal Scientist, Real-Time Multimodal Conversational AI

Amazon Inc.

Omaha (NE)

On-site

USD 229,000 - 309,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) matching
Paid time off
Parental leave

Job summary

Amazon is seeking a Principal Applied Scientist to drive real-time multimodal conversational AI, spanning speech, text, and audio. You will guide research from pre-training to post-training alignment and ensure models are ready for real-time deployment with low latency.

You will set technical direction, influence roadmaps, and partner with inference engineers to deliver production-ready solutions at scale in a frontier research environment.

Qualifications

  • Experience distilling informal customer requirements into problem definitions.
  • 10+ years of applied research experience.
  • Hands-on training of large-scale foundation models.
  • Experience with multimodal model architectures spanning speech/text/audio.
  • Strong understanding of transformer architectures in speech/audio domains.
  • Publication record at top venues in ML/AI.
  • Demonstrated principal/staff+ scientific leadership and mentorship.

Responsibilities

  • Build and train large-scale multimodal foundation models for real-time speech and audio generation.
  • Advance scaling and efficiency for conversational models, balancing data, model size and latency.
  • Design model architectures considering hardware constraints for real-time deployment.
  • Develop training methodologies for multimodal models handling speech, language and audio in real-time.
  • Design and build reward models for speech systems focusing on naturalness and responsiveness.
  • Apply RL methods to shape conversational behavior and real-time interaction.
  • Create post-training pipeline from SFT through RL alignment for real-time outputs.
  • Develop evaluation frameworks for real-time conversational quality.
  • Advance real-time perception and generation capabilities and align with production latency budgets.

Skills

Customer requirements
Applied research
Foundation models
Multimodal models
Transformer architectures
Publications
Scientific leadership

Education

PhD in CS/ML/EE/Speech or equivalent

Job description

Amazon is seeking a Principal Applied Scientist to drive real-time multimodal conversational AI, spanning speech, text, and audio. You will guide research from pre-training to post-training alignment and ensure models are ready for real-time deployment with low latency.

You will set technical direction, influence roadmaps, and partner with inference engineers to deliver production-ready solutions at scale in a frontier research environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Applied Scientist - Real-Time Multimodal AI
Principal Applied Scientist - Real-Time Multimodal AI

Amazon Inc. • Seattle (WA)

On-site
USD 199,000 - 269,000
Lead Scientist: Real-Time Multimodal Conversational AI
Lead Scientist: Real-Time Multimodal Conversational AI

Amazon Inc. • Boston (MA)

On-site
USD 199,000 - 269,000
Sign-on payments
RSUs
Health insurance
+3
Principal AI Scientist, Conversational CX
Principal AI Scientist, Conversational CX

Amazon Web Services (AWS) • Santa Clara (CA)

On-site
USD 229,000 - 309,000
Health insurance
RSUs
Stock options
Principal Applied Scientist, Real-Time Conversational AI , AGI
Principal Applied Scientist, Real-Time Conversational AI , AGI

Amazon Inc. • Seattle (WA)

On-site
USD 199,000 - 269,000
Principal Applied Scientist, Real-Time Conversational AI , AGI
Principal Applied Scientist, Real-Time Conversational AI , AGI

Amazon • Omaha (NE)

On-site
USD 229,000 - 309,000
Health insurance
401(k) matching
Paid time off
+1
Principal Applied Scientist, Real-Time Conversational AI , AGI
Principal Applied Scientist, Real-Time Conversational AI , AGI

Amazon Inc. • Boston (MA)

On-site
USD 199,000 - 269,000
Sign-on payments
RSUs
Health insurance
+3
Senior AI Scientist, Conversational AI & LLMs
Senior AI Scientist, Conversational AI & LLMs

Amazon • Santa Clara (CA)

On-site
USD 229,000 - 309,000
Health insurance
RSUs
401(k) matching
+1
Director, Applied AI for Conversational Commerce
Director, Applied AI for Conversational Commerce

Amazon Inc. • Seattle (WA)

On-site
USD 263,000 - 350,000
Director of Applied Science — Conversational AI
Director of Applied Science — Conversational AI

Amazon Inc. • Palo Alto (CA)

On-site
USD 298,000 - 350,000
Health insurance
RSUs
401(k) matching
+2
Applied Scientist - Multimodal AI for Customer Experience
Applied Scientist - Multimodal AI for Customer Experience

Amazon Inc. • Arlington (VA)

On-site
USD 143,000 - 193,000
Health insurance
401(k) matching
Paid time off
+1