Senior Applied Scientist, LLM Fine-Tuning & Agentic AI

Amazon; Berwick (Columbia County); On-site; USD 167,000 - 226,000; Full time

Benefits offered by this job

RSUs

Health insurance

Job summary

Amazon's Alexa AI division is seeking a Senior Applied Scientist to advance Alexa+ with LLM-powered conversational capabilities. You will drive end-to-end ML work from research to production, focusing on fine-tuning, alignment, and evaluation.

You will design rigorous experiments, develop scalable models, and collaborate across teams to deliver measurable customer impact for hundreds of millions of users worldwide.

Qualifications

• PhD/MS in Computer Science, Electrical Engineering, Machine Learning, NLP, or related field, OR Master’s with 5+ years of industry experience.
• 3+ years hands-on experience in applied ML, predictive modeling, or NLP.
• Strong programming skills in Python or a related language.
• Experience with deep learning frameworks (PyTorch, TensorFlow).
• Track record of delivering ML/NLP solutions from research to production.
• Experience working with large language models (training, fine-tuning, or evaluation).

Responsibilities

• Design, implement, and evaluate novel approaches to LLM fine-tuning, alignment (RLHF, DPO), and distillation for production deployment.
• Develop and improve agentic systems — including multi-step reasoning, tool use, planning, and orchestration — that work reliably at scale.
• Build evaluation frameworks and methodologies that go beyond standard benchmarks to capture real-world conversational quality.
• Translate research advances into customer-facing products, working closely with engineering, product, and cross-functional science teams.
• Analyze large-scale experimental results, identify patterns, and iterate rapidly on model improvements.
• Publish results at top-tier venues and contribute to Amazon's presence in the broader research community.
• Mentor junior scientists and contribute to hiring efforts.

Skills

Python

PyTorch

TensorFlow

NLP

Education

PhD or MS in CS/EE/ML or related field

Tools

Java

C++

Python

Job description

Amazon's Alexa AI division is seeking a Senior Applied Scientist to advance Alexa+ with LLM-powered conversational capabilities. You will drive end-to-end ML work from research to production, focusing on fine-tuning, alignment, and evaluation.

You will design rigorous experiments, develop scalable models, and collaborate across teams to deliver measurable customer impact for hundreds of millions of users worldwide.