Forward Deployed AI Engineer II — Customer Deployments

Amazon Web Services (AWS)

Boston (MA)

On-site

USD 144,000 - 194,000

Full time

9 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AWS is seeking a Forward Deployed Engineer II on the Custom Model and Optimization team in the Boston area. You will embed with strategic customers to build, optimize, and run custom generative AI models in production with their engineering teams, owning complete model workstreams from data prep to deployment.

You will design evaluation bars, develop data pipelines, and optimize training and inference using advanced frameworks.

Qualifications

  • 3+ years of non-internship software development experience.
  • 2+ years of design or architecture experience on scalable systems.
  • Hands-on experience with generative AI technology such as LLMs or related models.

Responsibilities

  • Embed within customer ML and engineering teams to translate goals into measurable evaluation bar and technical plan.
  • Customize and post-train models including open-weight and foundation models for customer domains.
  • Build large-scale training and inference systems with distributed training and RL post-training pipelines.
  • Optimize models on AWS chips, migrating to AWS Trainium and tuning for latency and cost.
  • Codify reusable fine-tuning recipes and patterns for future deployments and customer benefits.

Skills

3+ years software
2+ years design/architecture
Programming experience
Generative AI experience

Education

Bachelor's degree in CS or equivalent

Tools

PyTorch FSDP2
Megatron-LM
Miles
verl
NeMo Gym
OpenEnv
SGLang
vLLM
CUDA
Triton

Job description

AWS is seeking a Forward Deployed Engineer II on the Custom Model and Optimization team in the Boston area. You will embed with strategic customers to build, optimize, and run custom generative AI models in production with their engineering teams, owning complete model workstreams from data prep to deployment.

You will design evaluation bars, develop data pipelines, and optimize training and inference using advanced frameworks.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Forward Deployed AI Engineer II: GenAI & Optimization
Forward Deployed AI Engineer II: GenAI & Optimization

Amazon Web Services (AWS) • Arlington (VA)

On-site
USD 144,000 - 194,000
Embedded AI Model Engineer II
Embedded AI Model Engineer II

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Embedded AI Engineer: Generative Models for Clients
Embedded AI Engineer: Generative Models for Clients

Amazon Web Services (AWS) • East Palo Alto (CA)

On-site
USD 144,000 - 214,000
Health insurance
401(k) matching
Paid time off
+1
Senior AI Deployment Engineer – Custom Models & Optimization
Senior AI Deployment Engineer – Custom Models & Optimization

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Embedded AI Model Engineer: Customization & Optimization
Embedded AI Model Engineer: Customization & Optimization

Amazon Inc. • Arlington (VA)

On-site
USD 144,000 - 194,000
Forward-Deployed AI Systems Engineer
Forward-Deployed AI Systems Engineer

Amazon Web Services (AWS) • New York (NY)

On-site
USD 158,000 - 214,000
Forward Deployed AI Engineer II for Production
Forward Deployed AI Engineer II for Production

Amazon Web Services (AWS) • Arlington (VA)

On-site
USD 144,000 - 194,000
Health insurance
RSUs / Stock options
Paid time off
Forward‑Deployed AI Engineer
Forward‑Deployed AI Engineer

Amazon Web Services (AWS) • Boston (MA)

On-site
USD 144,000 - 194,000
Senior AI Systems Architect — Embedded, Production-Ready ML
Senior AI Systems Architect — Embedded, Production-Ready ML

Amazon Inc. • Seattle (WA)

On-site
USD 168,000 - 227,000
Forward-Deployed AI Engineer for AWS Production Systems
Forward-Deployed AI Engineer for AWS Production Systems

Amazon Inc. • Austin (TX)

On-site
USD 180,000 - 260,000