GenAI Platform Architect - Multi-GPU & LLM Ops

Industriasa; Boston (MA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Quantiphi is seeking an Architect - Platform Engineer to design, optimize, and scale GenAI infrastructure. You will drive GPU profiling, distributed training, and multi-GPU performance, collaborating with data science, MLOps, and application teams to deploy production-grade AI solutions.

You will implement reusable IaC templates, work with Slurm clusters, and advance GenAI pipelines in a fast-paced, client-facing environment. East/Canada location expected.

Qualifications

• Experience with Slurm and distributed training environments.
• Hands-on expertise with Red Hat OpenShift and or Kubernetes.
• Deep knowledge of the NVIDIA GPU ecosystem (CUDA, cuDNN, NCCL, Nsight, Triton/TensorRT).
• Strong foundation in Linux systems, performance tuning, and multi-GPU optimization.
• Experience deploying GenAI workloads (LLM fine-tuning, RAG pipelines, multi-modal systems).
• Familiarity with Infrastructure-as-Code tools (Terraform, Ansible).
• Experience with cloud GPU environments (GCP, Azure, AWS, OCI) and/or on-prem GPU clusters.

Responsibilities

• Design and implement scalable infrastructure for LLM and GenAI workloads across multi-GPU environments.
• Perform GPU profiling, benchmarking, and performance optimization for distributed training workloads.
• Manage and schedule compute-intensive jobs using Slurm-based clusters and OpenShift/Kubernetes environments.
• Enable and optimize the NVIDIA GPU stack (CUDA, cuDNN, NCCL, Triton, RAPIDS, etc.).
• Collaborate with cross-functional teams to deploy models in research and production environments.
• Build and support GenAI pipelines (fine-tuning, RAG, multi-modal inferencing, LLMOps).
• Develop reusable infrastructure templates using tools like Terraform and Helm.
• Contribute to internal innovation (PoCs, workshops) and support client-facing delivery engagements.

Skills

Slurm

OpenShift

Kubernetes

NVIDIA GPU ecosystem

Linux performance

LLM/GenAI workloads

Terraform/Helm

NVIDIA CUDA/cuDNN

GPU profiling

MLOps integration

Tools

OpenShift

Kubernetes

Terraform

Helm

Ansible

Job description

Quantiphi is seeking an Architect - Platform Engineer to design, optimize, and scale GenAI infrastructure. You will drive GPU profiling, distributed training, and multi-GPU performance, collaborating with data science, MLOps, and application teams to deploy production-grade AI solutions.

You will implement reusable IaC templates, work with Slurm clusters, and advance GenAI pipelines in a fast-paced, client-facing environment. East/Canada location expected.