Applied Scientist: AI for Advertiser Support & Evaluation

Amazon; Seattle (WA); On-site; USD 143,000 - 193,000; Full time

Benefits offered by this job

Health insurance

RSUs

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Advertising is seeking an Applied Scientist to join the Support Agent Intelligence and Evaluation team in Seattle. You will enhance agent capabilities across Sponsored Products, Brands, DSP and more, designing evaluation frameworks and building retrieval and generation models with strict latency SLAs.

You will drive multilingual evaluation, partner with product and engineering teams, and translate research into product decisions while shaping metrics that truly measure advertiser success.

Qualifications

• 3+ years of building models for business application experience.
• PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
• Experience in patents or publications at top-tier peer-reviewed conferences or journals
• Experience programming in Java, C++, Python or related language
• Experience in algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

Responsibilities

• Enhance support agent capabilities across the broad suite of Amazon Advertising products.
• Design and own the evaluation framework for agent quality, including automated LLM-based scoring of answer correctness, confidence calibration, and conversation-level resolution signals
• Develop novel metrics that capture whether advertisers actually got the help they needed (beyond surface-level deflection rates)
• Build and improve retrieval and generation models that power real-time advertiser interactions under strict latency SLAs
• Drive multilingual science — improve non-English resolution rates through cross-lingual retrieval, translation quality modeling, and locale-aware evaluation
• Partner with product, engineering, and business teams to productize research and inform roadmap decisions with data

Skills

Model development

Java

C++

Python

Algorithms

Education

PhD or MS + CS/CE/ML

Tools

Unix/Linux

Job description

Amazon Advertising is seeking an Applied Scientist to join the Support Agent Intelligence and Evaluation team in Seattle. You will enhance agent capabilities across Sponsored Products, Brands, DSP and more, designing evaluation frameworks and building retrieval and generation models with strict latency SLAs.

You will drive multilingual evaluation, partner with product and engineering teams, and translate research into product decisions while shaping metrics that truly measure advertiser success.