Head of Distributed Search & ML Infrastructure

Amazon Inc.

Palo Alto (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

RSUs
Sign-on bonus
Health insurance

Job summary

Amazon in Palo Alto is seeking an senior engineering leader to drive LLM/deep-learning relevance and scalable ranking systems serving billions of queries daily.

You will guide architecture decisions, own the full lifecycle of your team's products, and manage a high-performing engineering group focused on efficient, low-latency distributed software systems and ML infrastructure. Expect a strong emphasis on leadership and collaboration with cross-functional teams.

Qualifications

  • 5+ years of engineering team management experience.
  • 10+ years of working directly within engineering teams experience.
  • 8+ years of developing large-scale, multi-tiered distributed software systems.
  • Knowledge of full software/hardware/networks development life cycle.
  • Experience delivering products against plan in a fast-paced environment.

Responsibilities

  • Lead development of LLM/deep-learning relevance and ranking systems serving billions of queries at scale.
  • Improve search engine efficiency to reduce infrastructure cost.
  • Drive architecture and design decisions aligned with the search org vision.
  • Own full development and operations lifecycle of your team's products.
  • Manage engineering team: staffing, day-to-day execution, delivery commitments, and mentoring and career growth.
  • Report on development progress, quality, operations, and system performance.
  • Define long-term vision and growth plans in partnership with Science and Engineering leaders.
  • Set development priorities and evangelize the team's work across the org.

Skills

Distributed systems
Team leadership
Machine learning infra
LLM fundamentals
GPU programming
Communication
Big data tech

Tools

TensorFlow
PyTorch

Job description

Amazon in Palo Alto is seeking an senior engineering leader to drive LLM/deep-learning relevance and scalable ranking systems serving billions of queries daily.

You will guide architecture decisions, own the full lifecycle of your team's products, and manage a high-performing engineering group focused on efficient, low-latency distributed software systems and ML infrastructure. Expect a strong emphasis on leadership and collaboration with cross-functional teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager, ML Data Infrastructure
Engineering Manager, ML Data Infrastructure

Amazon Inc. • Palo Alto (CA)

On-site
USD 213,000 - 288,000
Health insurance
401(k) matching
Paid time off
+2
Software Development Manager, Core Search
Software Development Manager, Core Search

Amazon Inc. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
RSUs
Sign-on bonus
Health insurance
Senior ML Engineer - Search & Discovery Leader
Senior ML Engineer - Search & Discovery Leader

Coupang, Inc. • Mountain View (CA)

Hybrid
USD 187,000 - 322,000
Medical Insurance
Dental Insurance
Vision Insurance
+8
AI Platforms Engineer — Large-Scale ML/LLM Systems
AI Platforms Engineer — Large-Scale ML/LLM Systems

Amazon Development Center U.S., Inc. • Santa Clara (CA)

On-site
USD 130,000 - 210,000
Health insurance
RSUs
Sign-on bonus
Senior ML Infrastructure Engineer - GenAI & Scale
Senior ML Infrastructure Engineer - GenAI & Scale

Amazon Inc. • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
+1
Senior Applied Science Manager, AI-Driven Search
Senior Applied Science Manager, AI-Driven Search

Amazon Inc. • Omaha (NE)

On-site
USD 219,000 - 296,000
Applied Scientist II: ML for Search Ranking & Relevance
Applied Scientist II: ML for Search Ranking & Relevance

Amazon Inc. • Palo Alto (CA)

On-site
USD 172,000 - 222,000
Health insurance
401(k) matching
Parental leave
+1
Technical Lead - ML Systems for Search (Remote-friendly)
Technical Lead - ML Systems for Search (Remote-friendly)

Atlassian • San Francisco (CA)

Remote
USD 273,000 - 356,000
Health and wellbeing resources
Paid volunteer days
Equity
SDE: AI/ML Services & Large-Scale Systems
SDE: AI/ML Services & Large-Scale Systems

Amazon Web Services • New York (NY)

On-site
USD 158,000 - 214,000
AI Services Software Engineer (ML/LLM)
AI Services Software Engineer (ML/LLM)

Amazon Jobs • Santa Clara (CA)

On-site
USD 165,000 - 224,000
Health insurance
401(k) matching
Paid time off