Senior AI Forward-Deployed Engineer

Amazon Inc.; Boston (MA); On-site; USD 168,000 - 227,000; Full time

Job summary

Amazon Inc. is seeking a Senior Forward Deployed Engineer to lead customer engagements on custom generative AI models. You will define strategies, set success metrics, and steer production deployments with a focus on quality, latency, and cost.

Travel up to 25% may be required. You will architect distributed training and inference pipelines, integrate with AWS Trainium via Neuron SDK, and mentor a team of engineers and scientists.

Qualifications

• 5+ years of non-internship software development experience.
• Hands-on experience training, fine-tuning, or optimizing deep learning models.
• Experience communicating technical concepts to both technical and non-technical audiences, including senior leadership.

Responsibilities

• Lead the technical engagement: Embed with the customer as the technical lead for their model customization and optimization program.
• Define the customization strategy to meet quality, latency, and cost targets.
• Architect training and inference systems at scale for large models and diverse workloads.
• Lead migrations and optimization on AWS Trainium using the AWS Neuron SDK to improve performance and cost.
• Mentor and coach FDEs and scientists, lead design reviews, and participate in hiring.
• Identify reusable patterns and contribute to roadmaps across AWS services.

Skills

Software development

Leadership

Communication

Deep learning

Education

Bachelor's degree in CS or equivalent

Tools

SGLang

vLLM

TensorRT-LLM

Megatron-LM

PyTorch

NeMo-RL

Job description

Amazon Inc. is seeking a Senior Forward Deployed Engineer to lead customer engagements on custom generative AI models. You will define strategies, set success metrics, and steer production deployments with a focus on quality, latency, and cost.

Travel up to 25% may be required. You will architect distributed training and inference pipelines, integrate with AWS Trainium via Neuron SDK, and mentor a team of engineers and scientists.