Senior Staff AI Platform Engineer (MLOps)

Shield

San Mateo (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Shield AI seeks a Senior Staff Engineer to shape and build the AI Factory Reference Architecture, a Kubernetes-native platform for AI development, distributed training, simulation, evaluation, and deployment. You will work closely with ML researchers, platform engineers, and autonomy teams to deliver an exceptional developer experience.

You will balance researcher productivity, platform simplicity, operational excellence, and long-term maintainability while hands-on across stack.

Qualifications

  • Experience building Kubernetes-native AI or MLOps platforms supporting distributed machine learning workloads.
  • Deep understanding of modern AI training frameworks, including PyTorch and Hugging Face Transformers.
  • Experience operating GPU-accelerated infrastructure and distributed training systems.
  • Strong understanding of Kubernetes, Linux, networking, security, storage, and distributed systems.
  • Experience with GPU scheduling concepts and large-scale AI workloads.
  • Experience packaging and deploying cloud-native infrastructure using Terraform and Helm.
  • Strong software engineering skills in Python and Golang and modern cloud-native technologies.
  • Experience collaborating with ML researchers to translate research workflows into scalable platform capabilities.

Responsibilities

  • Lead the design and implementation of the Kubernetes-native AI Factory Reference Architecture for development, training, simulation, evaluation, and deployment.
  • Partner with ML researchers to support evolving training workflows and frameworks.
  • Design self-service AI development workflows enabling local experiments to large-scale distributed execution.
  • Build infrastructure for distributed training, simulation, inference, and reinforcement learning workloads with scalable orchestration and scheduling.
  • Design shared GPU infrastructure across cloud and on-prem environments for improved utilization.
  • Build platform capabilities for dataset management, experiment tracking, artifact management, model versioning, evaluation, deployment, and monitoring.
  • Develop repeatable deployment and lifecycle management solutions using Infrastructure as Code for cloud, customer-managed, sovereign, and air-gapped environments.
  • Evaluate emerging AI infrastructure technologies and define architectural patterns balancing scalability and maintainability.
  • Collaborate across AI researchers, autonomy teams, and product teams to evolve the platform with customer needs.

Skills

Kubernetes-native AI
MLOps platforms
Distributed training
PyTorch
Hugging Face Transformers
Kubernetes
Linux
Networking
Terraform
Helm
Python
Golang
Open-source tooling

Tools

Ray
Slurm

Job description

Shield AI seeks a Senior Staff Engineer to shape and build the AI Factory Reference Architecture, a Kubernetes-native platform for AI development, distributed training, simulation, evaluation, and deployment. You will work closely with ML researchers, platform engineers, and autonomy teams to deliver an exceptional developer experience.

You will balance researcher productivity, platform simplicity, operational excellence, and long-term maintainability while hands-on across stack.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff ML Ops Engineer — AI Platform (Kubernetes)
Senior Staff ML Ops Engineer — AI Platform (Kubernetes)

Precision Labs • San Mateo (CA)

Hybrid
USD 210,000 - 320,000
Senior Staff ML Platform Engineer — AI Factory
Senior Staff ML Platform Engineer — AI Factory

F7d8749a • San Mateo (CA)

On-site
USD 210,000 - 260,000
Senior Staff ML Platform Engineer (Kubernetes AI Factory)
Senior Staff ML Platform Engineer (Kubernetes AI Factory)

F7d8749a • San Diego (CA)

On-site
USD 180,000 - 260,000
Senior Platform Engineer, AI Compute & GPU Kubernetes
Senior Platform Engineer, AI Compute & GPU Kubernetes

F7d8749a • San Diego (CA)

On-site
USD 180,000 - 260,000
Platform Engineer, AI Compute & GPU Orchestration
Platform Engineer, AI Compute & GPU Orchestration

Shield AI • San Mateo (CA)

On-site
USD 200,000 - 300,000
Bonus
Benefits
Equity
Senior Staff Engineer, ML Ops (R4941)
Senior Staff Engineer, ML Ops (R4941)

F7d8749a • San Mateo (CA)

On-site
USD 210,000 - 260,000
Senior Staff Engineer, ML Ops (R4941)
Senior Staff Engineer, ML Ops (R4941)

F7d8749a • San Diego (CA)

On-site
USD 180,000 - 260,000
Staff Platform Engineer: Kubernetes-native AI Platform
Staff Platform Engineer: Kubernetes-native AI Platform

Shield • San Diego (CA)

On-site
USD 180,000 - 240,000
Staff AI Ops & Governance Engineer
Staff AI Ops & Governance Engineer

Remote • San Francisco (CA)

On-site
USD 180,000 - 260,000
Staff AI Platform Architect | Enterprise LLM & Governance
Staff AI Platform Architect | Enterprise LLM & Governance

Remote • San Francisco (CA)

On-site
USD 180,000 - 240,000