Senior AI Model Customization & Optimization Lead

Amazon Web Services (AWS); New York (NY); On-site; USD 185,000 - 250,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) is seeking a Senior Forward Deployed Engineer to act as the technical lead embedded with a customer for customizing and optimizing generative AI models at production scale. You will define strategy, metrics, and roadmaps, balancing quality, latency, and cost while working across multiple workstreams.

Responsibilities include designing distributed training and inference systems, optimizing on AWS Trainium, and mentoring a team of FDEs and scientists.

Qualifications

• 5+ years of non-internship professional software development experience.
• Experience leading design or architecture (design patterns, reliability and scaling) of new and existing systems.
• Hands-on experience training, fine-tuning, or optimizing deep learning models.
• Experience communicating technical concepts to both technical and non-technical audiences, including senior leadership.

Responsibilities

• Lead the technical engagement: embed with the customer as the technical lead for their model customization and optimization program, spanning multiple workstreams.
• Define the customization strategy to meet quality, latency, and cost targets across prompting, distillation, fine-tuning, or domain models.
• Architect training and inference systems at scale, including distributed training and RL post-training with production-ready serving strategies.
• Lead optimization on AWS AI chips, migrating workloads to AWS Trainium and closing gaps against GPU baselines.
• Mentor FDEs and scientists, lead design reviews, and participate in hiring and interviewing.
• Identify reusable patterns and influence AWS roadmaps for services like Bedrock and SageMaker AI.
• Oversee engagement execution with milestones, risk management, and delivery quality.

Skills

Technical leadership

Software development

Mentorship

Stakeholder communication

System design

Education

Bachelor's degree in Computer Science or equivalent

Tools

PyTorch FSDP2

Megatron-LM

Miles

verl

NeMo Gym

OpenEnv

SGLang

vLLM

TensorRT-LLM

Job description

Amazon Web Services (AWS) is seeking a Senior Forward Deployed Engineer to act as the technical lead embedded with a customer for customizing and optimizing generative AI models at production scale. You will define strategy, metrics, and roadmaps, balancing quality, latency, and cost while working across multiple workstreams.

Responsibilities include designing distributed training and inference systems, optimizing on AWS Trainium, and mentoring a team of FDEs and scientists.