Senior Platform Engineer – Data & ML Pipelines

PlusAI; Santa Clara (CA); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Unlimited PTO

Flexible working

Health benefits

Equity, 401k and FSA

Professional development

Catered lunches

Job summary

PlusAI is seeking a Software Engineer to strengthen our Kubernetes platform, focusing on reliability, onboarding, and scalable batch/workflow capabilities for petabyte-scale processing.

You will operate production Kubernetes clusters end to end, implement GitOps with Argo CD, Helm, and Kustomize, and collaborate on multi-tenant compute, GPU scheduling, and data-processing pipelines with Spark.

Qualifications

• BS, MS, or PhD in Computer Science or related field, or equivalent practical experience.
• Hands-on experience operating production Kubernetes clusters with node lifecycle, upgrades, troubleshooting, and GitOps and infrastructure-as-code.
• Self-driven with ownership and ability to drive projects end to end.
• Experience with GPU or ML workload scheduling, queueing and priorities, fractional GPU sharing, autoscaling, or multi-tenant resource management.

Responsibilities

• Improve reliability and efficiency of Kubernetes infrastructure.
• Make workload onboarding simpler and more self-service.
• Build reusable batch and workflow capabilities for petabyte-scale processing.
• Operate production Kubernetes clusters end to end including provisioning, control planes, GPUs, networking, and storage.
• Develop GitOps-based delivery using Argo CD, Helm, and Kustomize.
• Create multi-tenant platform capabilities for scheduling, isolation, storage, networking, and observability.
• Build and enhance distributed batch/workflow platforms for Spark processing and GPU replay/simulation.

Skills

Kubernetes

Platform engineering

Distributed data processing

ML/GPU infrastructure

Multi-tenant compute systems

GitOps

Argo CD

Helm

Kustomize

Spark

Ray

Kubeflow

Argo Workflows

Delta Lake

Apache Iceberg

GPU workload scheduling

Autoscaling

Education

BS, MS, or PhD in Computer Science or related field

Tools

Argo CD

Helm

Kustomize

Kubeflow

Argo Workflows

Spark

Delta Lake

Apache Iceberg

Job description

PlusAI is seeking a Software Engineer to strengthen our Kubernetes platform, focusing on reliability, onboarding, and scalable batch/workflow capabilities for petabyte-scale processing.

You will operate production Kubernetes clusters end to end, implement GitOps with Argo CD, Helm, and Kustomize, and collaborate on multi-tenant compute, GPU scheduling, and data-processing pipelines with Spark.