Remote Principal AI/ML Platform Engineer

Optum

Eden Prairie (MN)

Remote

USD 165,000 - 282,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity stock purchase
401k contribution
Comprehensive benefits package
Remote work option

Job summary

Optum is seeking a Principal AI/ML Platform Engineer to lead the end-to-end reference architecture for multi-tenant AI compute platforms across hybrid OpenShift clusters and public-cloud AI services. You will drive network standards, governance, and automated lifecycle management to ensure scalable, secure AI workloads.

Responsibilities include cost modeling, model-serving standardization, workload placement decisions, and robust IAM controls.

Qualifications

  • Bachelor’s degree or 4+ years of equivalent software/platform engineering experience in lieu of a degree.
  • 10+ years of experience in infrastructure, DevOps, SRE, or ML platform engineering.
  • 5+ years of experience operating Kubernetes or OpenShift at scale in production bare-metal or enterprise cloud environments.
  • 3+ years of experience designing and managing accelerated-compute (AI/GPU) infrastructure utilizing NVIDIA GPU Operator, NFD, MIG/time-slicing, and DCGM.
  • 3+ years of experience architecting hybrid AI platforms spanning self-hosted IaaS and public-cloud PaaS managed AI services (e.g., Azure AI Foundry, AWS Bedrock, or GCP Vertex AI).
  • 3+ years of experience with HPC/AI networking technologies, including InfiniBand or RoCEv2, GPUDirect RDMA, and NCCL collective communication limits.
  • 3+ years of experience managing multi-cluster fleets using RHACM (or equivalent) and GitOps tooling (Argo CD or Flux).
  • 3+ years of experience implementing enterprise security and IAM controls for software workloads (RBAC, OIDC/OAuth, Vault secrets management, mTLS).

Responsibilities

  • Own the end-to-end reference architecture for multi-tenant AI compute platforms across hybrid on-premises bare-metal OpenShift AI clusters and public-cloud managed AI platforms (Azure AI Foundry, AWS Bedrock, GCP Vertex AI).
  • Set network, latency, and topology standards for distributed training (NVLink, InfiniBand, RoCEv2, GPUDirect RDMA, NCCL), ensuring interconnect boundaries are strictly maintained.
  • Establish cluster governance, GitOps workflows (Argo CD), RHACM policies, and automated lifecycle management for bare-metal accelerated compute nodes.
  • Design cost and utilization models including capex amortization, accelerator-sharing strategies (MIG/time-slicing), and cost-per-token/training-run math to inform accelerator procurement roadmaps.
  • Standardize model-serving platforms (vLLM, KServe) and inference gateways, setting quantization policies, provenance review gates, and intelligent model routing rules.
  • Define workload placement frameworks to determine self-hosted versus managed cloud deployment based on data residency, latency, cost, and compliance requirements.
  • Design and enforce identity, access, and security controls for AI workloads and autonomous agents, including least-privilege RBAC, Vault secret management, short-lived credentials, and mTLS.
  • Establish enterprise Service Level Objectives (SLOs), disaster recovery plans, and upgrade strategies for OpenShift, OpenShift AI, GPU operators, drivers, and firmware.
  • Partner with cross-functional AI teams, LLM gateway engineers, privacy, and security stakeholders to ensure seamless integration and HIPAA compliance.

Skills

Kubernetes
OpenShift
RHACM
GitOps
Security controls

Education

Bachelor’s degree or equivalent experience

Tools

Kubernetes
OpenShift
ARgo CD

Job description

Optum is seeking a Principal AI/ML Platform Engineer to lead the end-to-end reference architecture for multi-tenant AI compute platforms across hybrid OpenShift clusters and public-cloud AI services. You will drive network standards, governance, and automated lifecycle management to ensure scalable, secure AI workloads.

Responsibilities include cost modeling, model-serving standardization, workload placement decisions, and robust IAM controls.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Director of AI/ML Engineering | Healthcare Platform
Remote Director of AI/ML Engineering | Healthcare Platform

Optum • Irvine (CA)

Remote
USD 177,000 - 303,000
Equity stock purchase
401k contribution
Comprehensive benefits
Senior AI Platform Architect
Senior AI Platform Architect

UnitedHealth Group • Eden Prairie (MN)

Remote
USD 165,000 - 282,000
Lead AI/ML Architect for Enterprise Platforms
Lead AI/ML Architect for Enterprise Platforms

Optum • Eden Prairie (MN)

Remote
USD 146,000 - 250,000
Comprehensive benefits
Equity stock purchase
401k contribution
Remote Senior AI Product & Platform Lead
Remote Senior AI Product & Platform Lead

NaviHealth • Boston (MA)

Remote
USD 185,000 - 317,000
Comprehensive benefits package
Incentive and recognition programs
Equity stock purchase and 401k
Senior AI/ML Platform Architect & MLOps Lead
Senior AI/ML Platform Architect & MLOps Lead

UnitedHealth Group • Minneapolis (MN)

On-site
USD 146,000 - 250,000
Comprehensive benefits
Equity stock purchase
401k plan
Senior GenAI Platform Engineer (OpenShift/AWS)
Senior GenAI Platform Engineer (OpenShift/AWS)

Optomi • Texas

On-site
USD 140,000 - 180,000
Head of AI Platform & ML Engineering
Head of AI Platform & ML Engineering

UnitedHealth Group • Minnetonka (MN)

On-site
USD 177,000 - 303,000
Comprehensive benefits package
Equity stock purchase
401k contribution
+1
Remote Principal Data Engineer: AI-Driven Data Platform
Remote Principal Data Engineer: AI-Driven Data Platform

Optum • Eden Prairie (MN)

Remote
USD 113,000 - 193,000
Comprehensive benefits
Equity stock purchase
401k contribution
+1
Remote Principal AI Platform Product Manager
Remote Principal AI Platform Product Manager

UnitedHealth Group • Eden Prairie (MN)

Remote
USD 135,000 - 231,000
Principal AI/ML Engineer - Healthcare AI (Remote)
Principal AI/ML Engineer - Healthcare AI (Remote)

UnitedHealth Group • Eden Prairie (MN)

Remote
USD 180,000 - 260,000