Senior AI Model Customization & Optimization Engineer

Amazon Inc.; New York (NY); On-site; USD 185,000 - 250,000; Full time

Job summary

Amazon Web Services, Inc. is seeking a Senior Forward Deployed Engineer to lead model customization and optimization engagements embedded with strategic customers.

You will define strategies across prompting, fine-tuning, RL, adapters, and domain foundation models, while architecting scalable training and inference systems and driving production-ready solutions. You will also lead migrations to AWS Trainium, benchmark performance, and mentor a team of FDEs and scientists, shaping roadmaps across

Qualifications

• 5+ years of non-internship software development experience.
• Experience mentoring, tech lead, or leading an engineering team.
• Hands-on experience training, fine-tuning, or optimizing deep learning models.
• Experience communicating technical concepts to senior leadership and other audiences.

Responsibilities

• Lead the technical engagement embedded with the customer for model customization and optimization programs spanning multiple workstreams.
• Define customization strategy to meet quality, latency, and cost targets; decide on prompting, distillation, fine-tuning, RL, adapters, or domain foundation models.
• Architect training and inference systems at scale for large models using PyTorch FSDP2, Megatron-LM, Miles, and verl; design RL interaction harnesses with NeMo Gym and OpenEnv.
• Lead migrations of training and inference workloads to AWS Trainium using the AWS Neuron SDK; close capability gaps and provide benchmark-driven recommendations.
• Mentor FDEs and scientists; lead design reviews and contribute to hiring and engineering excellence.
• Identify reusable patterns and influence roadmaps across AWS services like Bedrock, SageMaker AI, and Neuron.

Skills

Software development

Leadership/mentoring

ML model experience

Technical communication

Education

Bachelor's degree in computer science or equivalent

Tools

PyTorch FSDP2

Megatron-LM

Miles

verl

SGLang

vLLM

TensorRT-LLM

NeMo RL

Job description

Amazon Web Services, Inc. is seeking a Senior Forward Deployed Engineer to lead model customization and optimization engagements embedded with strategic customers.

You will define strategies across prompting, fine-tuning, RL, adapters, and domain foundation models, while architecting scalable training and inference systems and driving production-ready solutions. You will also lead migrations to AWS Trainium, benchmark performance, and mentor a team of FDEs and scientists, shaping roadmaps across