Senior ML Engineer, GPU Compute & Infrastructure - On-site

Flexion; Zürich; On-site; CHF 150,000 - 210,000; Full time

Benefits offered by this job

Enhanced pension plan

Relocation & permit sponsorship

Enhanced holiday & paid leave perks

Central Zürich office with top-tier R

Job summary

Flexion in Zurich is seeking a senior ML engineer to own GPU compute platforms, design and bring up scalable clusters, and collaborate with AI engineers to accelerate training. You will shape multi-cloud compute strategies, optimize performance, and contribute to new tools that improve throughput on large models.

You will also mentor junior engineers and contribute to reliability improvements across the platform.

Qualifications

• Hands-on experience with training or inference of large models on distributed multi-node GPU hardware.
• Proficiency in Python and working knowledge of PyTorch.
• Deep understanding of distributed training concepts (DDP, FSDP, NCCL).
• Experience with at least one cloud platform (AWS, GCP, Azure) or large-scale on-premises GPU infrastructure.
• Experience with job scheduling and orchestration tools: Slurm and/or Kubernetes/KubeRay.

Responsibilities

• Architect, run and continuously improve existing and future cloud-based GPU clusters. Select the best frameworks and tooling to run our clusters efficiently.
• Help AI engineers optimize their training workloads and maximize hardware utilization using profilers, contributing to our core ML libraries.
• Contribute to short- and long-term GPU compute strategies in collaboration with our AI engineering teams and help execute on them.
• Optimize capacity and cost by exploring multi-cloud strategies and evaluating trade-offs.
• Raise the bar on engineering practices, including testing, code quality, documentation, and system reliability.

Skills

Python

Distributed training

Collaboration with AI engineers

Cloud experience

Profilers familiarity

Education

Degree in Computer Science, Electrical Engineering or Software Engineering

Tools

PyTorch

Slurm

Kubernetes/KubeRay

AWS/GCP/Azure

Job description

Flexion in Zurich is seeking a senior ML engineer to own GPU compute platforms, design and bring up scalable clusters, and collaborate with AI engineers to accelerate training. You will shape multi-cloud compute strategies, optimize performance, and contribute to new tools that improve throughput on large models.

You will also mentor junior engineers and contribute to reliability improvements across the platform.