Senior Embedded AI Systems Architect

Amazon Web Services (AWS); Boston (MA); On-site; USD 168,000 - 227,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services, Inc. seeks a Senior Forward Deployed Engineer to lead embedded customer engagements, shape the direction for model customization and optimization, and deliver production-ready AI workloads.

You will architect end-to-end training and inference systems, drive performance optimizations on AWS Trainium, and mentor a team of engineers while collaborating with executive stakeholders. You will define data and evaluation strategies for domain foundation models, manage

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one language.
• 5+ years leading design or architecture of systems.
• Experience as a mentor or tech lead.
• Hands-on experience training, fine-tuning, or optimizing deep learning models.
• Experience communicating technical concepts to technical and non-technical audiences, including senior leadership.

Responsibilities

• Lead the technical engagement: Embed with the customer as the technical lead for model customization and optimization program, spanning multiple workstreams.
• Define the customization strategy to meet quality, latency, and cost targets, including prompting, distillation, supervised fine-tuning, RL, and domain models.
• Architect training and inference systems at scale, designing distributed training and RL post-training workflows for large models.
• Lead optimization on AWS AI chips: migrate workloads to AWS Trainium and optimize performance against GPU baselines.
• Mentor and raise the bar: provide technical leadership, code reviews, and hiring input across the engagement.
• Multiply impact: develop reusable fine-tuning recipes, evaluation frameworks, and reference architectures across teams.

Skills

Non-internship software development

Programming experience

Design/architecture leadership

Mentor / tech lead

Deep learning model tuning

Technical communication to leadership

Education

Bachelor’s degree in computer science or equivalent

Experience deploying ML models in production

Evaluation strategy / benchmarks for generative models

LLM/AI model optimization / latency cost trade-offs

LLM post-training (SFT, RLHF, RL) experience

Distributed training of LLMs (MiME/ME)

Tools

SGLang

vLLM

TensorRT-LLM

PyTorch FSDP2

Megatron-LM

Miles

verl

NeMo‑RL

OpenRLHF

Job description

Amazon Web Services, Inc. seeks a Senior Forward Deployed Engineer to lead embedded customer engagements, shape the direction for model customization and optimization, and deliver production-ready AI workloads.

You will architect end-to-end training and inference systems, drive performance optimizations on AWS Trainium, and mentor a team of engineers while collaborating with executive stakeholders. You will define data and evaluation strategies for domain foundation models, manage