Forward Deployed Generative AI Engineer II

Amazon Web Services (AWS); Greater London; Hybrid; GBP 90,000 - 140,000; Full time

Job summary

Amazon Web Services (AWS) is seeking a Forward Deployed Engineer II to embed with customer teams, defining evaluation metrics and building end-to-end model workstreams from data prep to production deployment.

You will customize state-of-the-art open-weight models, migrate workloads to AWS Trainium, and optimize training and inference with advanced techniques. Travel up to 25% is expected.

Qualifications

• Professional, non-internship software development experience.
• Experience with Java, C++, or C# and OO design.
• 3+ years in a non-internship software role.
• 2+ years in Agile or fast-moving environments.
• Hands-on experience with generative AI tech and tools.

Responsibilities

• Embed with customer ML and engineering teams to understand business goals and data.
• Define evaluation bars and technical plans for model workstreams.
• Customize, pre-train, fine-tune, and deploy open-weight models for domains.
• Build data pipelines, synthetic data, and evaluation harnesses to prove performance.
• Design distributed training and inference pipelines using PyTorch/FSDP2 and Megatron-LM.
• Optimize through quantization, batching, and latency reduction across AWS Trainium.

Skills

Software development

OO design (Java/C++)

Agile experience

Generative AI

AI tools and frameworks

Technical communication

Education

Bachelor's degree or equivalent

Tools

PyTorch FSDP2

Megatron-LM

Miles

verl

Job description

Amazon Web Services (AWS) is seeking a Forward Deployed Engineer II to embed with customer teams, defining evaluation metrics and building end-to-end model workstreams from data prep to production deployment.

You will customize state-of-the-art open-weight models, migrate workloads to AWS Trainium, and optimize training and inference with advanced techniques. Travel up to 25% is expected.