Applied Scientist II - Global AI Agent Optimization

Amazon; New York (NY); On-site; USD 172,000 - 222,000; Full time

Job summary

Amazon's Global Optimization team is seeking an Applied Scientist to design agentic architectures, build tools and datasets, and enable autonomous reasoning across advertiser workflows at global scale.

You will collaborate with scientists, engineers, and product managers to productionize innovations in fine-tuning, reinforcement learning, and preference optimization while ensuring safety and reliability in the ad ecosystem.

Qualifications

• PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
• 3+ years of building models for business application experience
• Experience programming in Java, C++, Python or related language
• Experience in designing experiments and statistical analysis of results
• Experience in professional software development
• Experience with LLMs, AI Agents, MCPs, Chain of Thought reasoning

Responsibilities

• Design and build agents that improve advertisers experiences globally
• Design and implement advanced model and agent optimization techniques, including supervised fine-tuning, instruction tuning and preference optimization (e.g., DPO/IPO).
• Design and implement optimization models that work at global scale taking into account nuances of multiple countries
• Innovate new science models to help advertisers scale their campaigns globally
• Curate datasets and tools for MCP.
• Build evaluation pipelines for agent workflows, including automated benchmarks, multi-step reasoning tests, and safety guardrails.
• Develop agentic architectures (e.g., CoT, ToT, ReAct) that integrate planning, tool use, and long-horizon reasoning.
• Prototype and iterate on multi-agent orchestration frameworks and workflows.
• Collaborate with peers across engineering and product to bring scientific innovations into production.
• Stay current with the latest research in LLMs, RL, and agent-based AI, optimization and translate findings into practical applications.

Skills

Experiment design

Statistical analysis

Software development

LLM/Agents understanding

Education

PhD or Master's in CS/CE/ML

Tools

Java

C++

Python

Job description

Amazon's Global Optimization team is seeking an Applied Scientist to design agentic architectures, build tools and datasets, and enable autonomous reasoning across advertiser workflows at global scale.

You will collaborate with scientists, engineers, and product managers to productionize innovations in fine-tuning, reinforcement learning, and preference optimization while ensuring safety and reliability in the ad ecosystem.