Sr. Applied Scientist, Agent Evaluation and Experimentation, DTx Science

Amazon; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

Amazon Advertising is building a data-driven applied science organization focused on agent-based experiences across the Ads Console. The DTx Science team advances evaluation, experimentation, and measurement to improve advertiser interactions and outcomes through ML and AI techniques.

You will work with business leaders and cross-functional partners to shape roadmaps, promote data-driven decision making, and deliver measurable impact for advertisers globally.

Responsibilities

• Lead the development of agent evaluation, agent impact measurement, agent experimentation, and agent advertiser experience
• Lead high-ambiguity projects and drive alignment across teams on science and engineering solutions.
• Drive adoption of state-of-the-art scientific technologies in generative AI, reinforcement learning, causal inference, classical machine learning, and natural language processing to improve the team's existing science solutions.
• Translate complex scientific challenges into clear and impactful solutions for business stakeholders.
• Mentor and guide junior scientists, fostering a collaborative and high-performing team culture.
• Foster collaborations between scientists to move faster, with broader impact.
• Regularly engage with the broader scientific community with presentations, publications, and patents.

Job description

Description

Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products and solutions are strategically important to enable our Retail and Marketplace businesses to drive long-term growth. We deliver billions of ad impressions and millions of clicks and break fresh ground in product and technical innovations every day!

Demand Tech Experience (DTx), as an org, owns the Amazon Ads Console — the advertiser-facing workspace for creating and managing campaigns, reviewing performance, and acting on recommendations used by millions of advertisers. Our team, DTx Science, is the centralized science team within DTx, dedicated to improving and protecting the advertiser experience across ad consoles through applied science methodologies. The team drives impact through four core functions: Ad Console Personalization, Recommendation Development, Ad Console Experimentation, and DVA Agent Evaluation and Impact Measurement.

In this role, you will work closely with business leaders, stakeholders, and cross-functional teams to drive program success through ML- and agentic-driven solutions. You will shape the applied science roadmap, promote a culture of data-driven decision-making, and deliver significant business impact for millions of advertisers worldwide and the company using advanced data techniques and applied science methodologies.

Key job responsibilities

• Lead the development of agent evaluation, agent impact measurement, agent experimentation, and agent advertiser experience
• Lead high-ambiguity projects and drive alignment across teams on science and engineering solutions.
• Drive adoption of state-of-the‑art scientific technologies in generative AI, reinforcement learning, causal inference, classical machine learning, and natural language processing to improve the team's existing science solutions.
• Translate complex scientific challenges into clear and impactful solutions for business stakeholders.
• Mentor and guide junior scientists, fostering a collaborative and high‑performing team culture.
• Foster collaborations between scientists to move faster, with broader impact.
• Regularly engage with the broader scientific community with presentations, publications, and patents.

About the team

The DTx Science team is the centralized science team within Demand Tech Experience (DTx), dedicated to improving and protecting the advertiser experience across ad consoles through applied science methodologies. The team drives impact through four core functions: Ad Console Personalization, Recommendation Development, Ad Console Experimentation, and DVA Agent Evaluation and Impact Measurement.

Improve advertiser experience

Ad Console Personalization and Recommendation Development aim to improve the advertiser ad console experience by providing customized and personalized console experiences for each user and increasing their ad performance with relevant, science-backed onboarding and oppertunty recommendations.

Protect advertiser experience

Ad Console Experimentation and DVA Agent Evaluation and Impact Measurement protect the advertiser experience by supporting the organization in making data‑driven decisions to launch UX and agentic features that benefit advertisers.