Forward Deployed AI Engineer: Custom GenAI in Production

Amazon Inc.; Boston (MA); On-site; USD 144,000 - 194,000; Full time

Job summary

Amazon Inc. is seeking a Forward Deployed Engineer II to embed with strategic customers and build, optimize, and run custom generative AI models in production.

You will own end-to-end model workstreams from defining evaluation bars and preparing data to training, optimization, and deployment, collaborating closely with customer engineering teams. This role requires travel up to 25% and strong hands-on AI software skills.

Qualifications

• 3+ years of non-internship software development experience.
• 2+ years in design or architecture of new and existing systems.
• Experience programming in at least one software language.
• Hands-on experience with generative AI tech (LLMs, vision-language, or speech).

Responsibilities

• Embed with customer ML teams to understand business, data, model stack and constraints.
• Translate goals into a measurable evaluation bar and a technical plan for the workstream.
• Customize and post-train models for domains via continued pre-training and fine-tuning.
• Build distributed training and RL pipelines; optimize throughput and cost.
• Migrate and tune training/inference workloads to AWS Trainium and productionize models.

Skills

Software development

System design

Generative AI

Programming languages

Education

Bachelor's degree in CS

Distributed training of LLMs (multi-node)

LLM post-training (SFT, RLHF, RL)

Production ML deployment experience

Tools

PyTorch FSDP2

Megatron-LM

NeMo

DeepSpeed

Job description

Amazon Inc. is seeking a Forward Deployed Engineer II to embed with strategic customers and build, optimize, and run custom generative AI models in production.

You will own end-to-end model workstreams from defining evaluation bars and preparing data to training, optimization, and deployment, collaborating closely with customer engineering teams. This role requires travel up to 25% and strong hands-on AI software skills.