Senior AI/ML Solutions Architect – Kubernetes & GPU PaaS

Rafay Systems; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Rafay Systems seeks a Solutions Architect to help customers deploy, operate, and scale AI/ML workloads on our GPU PaaS. You will collaborate with platform engineering, MLOps, data science, and infrastructure teams to design production-ready AI infrastructure on Kubernetes and GPU environments.

You will onboard customers, optimize workload performance, automate infrastructure, and act as a trusted technical advisor throughout the lifecycle.

Qualifications

• 8+ years of experience in Solutions Architecture, DevOps, platform engineering or related fields.
• Hands-on Kubernetes experience in production environments.
• Proficiency with Python or Go for automation and tooling.
• Experience with AWS, Azure, or GCP including networking and IAM.
• Strong knowledge of Infrastructure as Code and automation tools (Terraform, Helm, GitOps, CI/CD).
• Familiar with monitoring/observability (Prometheus, Grafana, OpenTelemetry).
• Understanding AI/ML infrastructure incl. GPU workloads, model serving, pipelines.

Responsibilities

• Partner with customer teams to translate AI/ML workload requirements into scalable platform architectures.
• Design and deploy Kubernetes-based solutions for training, fine-tuning, and inference.
• Onboard customers to the GPU PaaS platform across cloud and hybrid environments.
• Configure networking, IAM, observability, and security integrations with enterprise systems.
• Build and maintain automation assets (Terraform modules, Helm charts, GitOps, CI/CD).
• Monitor production environments for GPU utilization, performance, health, and cost.
• Support root cause analysis and remediation for customer issues.
• Serve as day-to-day technical advisor and primary contact for assigned customers.
• Document best practices and provide feedback to Product/Engineering.
• Collaborate with internal teams to drive customer adoption and expansion.

Skills

Customer-facing communication

Troubleshooting

Cross-functional collaboration

Problem solving

Tools

Kubernetes

Python

Go

Terraform

Helm

GitOps

CI/CD

Prometheus

Grafana

OpenTelemetry

AWS

Azure

GCP

PyTorch

TensorFlow

Job description

Rafay Systems seeks a Solutions Architect to help customers deploy, operate, and scale AI/ML workloads on our GPU PaaS. You will collaborate with platform engineering, MLOps, data science, and infrastructure teams to design production-ready AI infrastructure on Kubernetes and GPU environments.

You will onboard customers, optimize workload performance, automate infrastructure, and act as a trusted technical advisor throughout the lifecycle.