Edge AI Platform Lead — Senior SDE & Systems Architect

Amazon; Vancouver; On-site; CAD 140,000 - 200,000; Full time

Benefits offered by this job

Health Insurance

RRSP

DPSP

Paid Time Off

Job summary

Amazon Devices (Lab126) is hiring a Senior Software Development Engineer to lead the architecture and delivery of core Edge AI ML Platform capabilities. You will work with scientists, ML engineers, and hardware teams to enable training, optimization, evaluation, and deployment of models on devices and in the cloud.

You will design and implement distributed training, compression pipelines, and artifact workflows, while driving CI/CD, observability, and reliability for GPU‑intensive workloads

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language.
• 5+ years of leading design or architecture of new and existing systems.
• Experience as a mentor, tech lead or leading an engineering team.
• Experience designing or building distributed or high‑performance computing systems.

Responsibilities

• Lead design and delivery of distributed ML platform services and libraries across model onboarding, optimization, training, evaluation, packaging and deployment.
• Define stable APIs and architecture boundaries to decouple research from training and deployment.
• Design distributed training across data, tensor, pipeline and model parallelism.
• Scale workflows on multi-node GPU clusters, improve throughput, memory, and recovery.
• Develop infrastructure connecting distributed training with distillation, quantization, pruning and other techniques.
• Build evaluation and artifact workflows and carry validated models to target hardware.
• Implement CI/CD, observability, and release mechanisms for GPU workloads.
• Profile and optimize end-to-end performance with scientists and kernel engineers.
• Establish on-call runbooks and incident practices for production services.
• Collaborate with model, compiler, runtime, hardware and product teams on multi‑team programs.
• Write designs, evaluate trade-offs, and build consensus when tech strategy is unclear.
• Mentor engineers, improve code review practices, and help recruit in Vancouver.

Skills

Software development

Programming experience

Architecture leadership

Mentor/Tech lead

Distributed systems

Tools

PyTorch

TensorFlow

JAX

NeMo

Megatron

Job description

Amazon Devices (Lab126) is hiring a Senior Software Development Engineer to lead the architecture and delivery of core Edge AI ML Platform capabilities. You will work with scientists, ML engineers, and hardware teams to enable training, optimization, evaluation, and deployment of models on devices and in the cloud.

You will design and implement distributed training, compression pipelines, and artifact workflows, while driving CI/CD, observability, and reliability for GPU‑intensive workloads