Applied Scientist II, Natural Language and Multimodal Search

Amazon; Seattle (WA); On-site; USD 143,000 - 193,000; Full time

Job summary

Amazon seeks an Applied Scientist II for Natural Language and Multimodal Search in Seattle. You will design and deploy deep-learning models that combine text and product images to improve search relevance and ranking for constrained shopping queries.

Expect cross-team collaboration, experimentation, and production-scale impact across millions of customer queries. Responsibilities include building data pipelines, training encoders, and running offline/online experiments.

Qualifications

• PhD, or Master's degree and 2+ years of CS, CE, ML or related field experience
• Experience programming in Java, C++, Python or related language
• Experience with ML, RL, DL, CV or NLP related applications

Responsibilities

• Design, train, and ship deep-learning ranking and semantic-matching models over text and images
• Build training data and evaluation methods including hard-negative mining
• Train and adapt vision-language encoders for multimodal relevance signals
• Create joint text and image embeddings for retrieval and ranking
• Run offline and online A/B experiments and iterate to improve relevance

Skills

Java

C++

Python

Machine Learning

NLP

Deep Learning

Computer Vision

Education

Masters or PhD in CS/CE/ML or related field

Job description

Applied Scientist II, Natural Language and Multimodal Search

Job ID: 10471620 | Amazon.com Services LLC

Amazon Search is reinventing how customers find products through natural-language and semantic understanding. We are looking for an Applied Scientist II to push the science behind Natural Language Search that interprets complex, constraint-rich shopping queries, and retrieves and ranks the most relevant products using both text and product images.

You will build and ship large-scale relevance and ranking models that measurably reduce the rate at which customers see irrelevant results, working on problems that span query understanding, multimodal semantic matching, and contextual ranking at Amazon scale.

Key job responsibilities

• Design, train, and ship deep-learning ranking and semantic-matching models over text and product images that improve search relevance and reduce how often customers see irrelevant results, across hard query types.
• Build the training data and evaluation methods that make these models work: synthetic and historical labels, hard-negative mining, and targeted sampling at the cases where search fails.
• Train and adapt vision-language encoders so product images become a first-class relevance signal, and verify visual constraints that text alone misses.
• Build joint text and image embeddings for retrieval and ranking, including contrastive training, hard-negative mining and fusion of modalities.
• Develop signals that match product attributes to what the customer actually asked for.
• Run offline and online A/B experiments, analyze precision/recall tradeoffs, and iterate to launch.
• Work with engineers and scientists across teams to take models from prototype to production at Amazon scale.

A day in the life

You work alongside scientists and engineers on some of the hardest open problems in search relevance, teaching models to understand what customers really mean when they ask for something specific and nuanced. A typical day blends model development and data curation with sharp experiment analysis: diagnosing where search breaks down for a query segment, designing the fix, and proving the gains through offline metrics and live A/B tests that reach real Amazon customers. The work spans the full range, from surgical fixes that resolve stubborn failure pattern to broad modeling changes that move relevance for millions of queries at once. You'll see your ideas go from whiteboard to production fast, present results regularly to wider team, and help shape the team's relevance roadmap worldwide.

About the team

We are the science team behind Amazon's semantic search relevance and ranking. We own the models that understand nuanced, multi-constraint shopping queries and show products customers actually want. We operate close to production, measure ourselves on real customer-impact metrics, and run a culture of fast, rigorous experimentation. Every model decision is grounded in data.

Basic Qualifications

• PhD, or Master's degree and 2+ years of CS, CE, ML or related field experience
• Experience programming in Java, C++, Python or related language
• Experience with one of the following areas: machine learning technologies, Reinforcement Learning, Deep Learning, Computer Vision, Natural Language Processing (NLP) or related applications

Preferred Qualifications

• Experience in machine learning, data mining, information retrieval, statistics or natural language processing
• 1+ years of building large-scale machine-learning infrastructure for online recommendation, ads ranking, personalization or search experience
• Experience with A/B testing
• Experience in practical work applying ML to solve complex problems for large scale applications
• Publications in ML, IR, or NLP venues (e.g., NeurIPS, ICML, SIGIR, KDD, ACL)
• Experience training large-scale or deep neural ranking/relevance models
• Experience taking ML models from prototype to production

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

Preferred Qualifications

• Experience in machine learning, data mining, information retrieval, statistics or natural language processing
• 1+ years of building large-scale machine-learning infrastructure for online recommendation, ads ranking, personalization or search experience
• Experience with A/B testing
• Experience in practical work applying ML to solve complex problems for large scale applications
• Publications in ML, IR, or NLP venues (e.g., NeurIPS, ICML, SIGIR, KDD, ACL)
• Experience training large-scale or deep neural ranking/relevance models
• Experience taking ML models from prototype to production

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

USA, WA, Seattle - 142,800.00 - 193,200.00 USD annually

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.