Senior GPU Cloud Infrastructure Engineer

Jack & Jill; San Francisco (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Jack & Jill is seeking a Senior GPU Platform Engineer to own the end-to-end GPU and cloud infrastructure powering real-time AI agents. You will provision clusters, manage Kubernetes environments, and optimize inference workloads for scalability and reliability.

The role requires deep hands-on experience operating GPU clusters in production, along with strong proficiency in Kubernetes and AWS to support a startup-ready ML infrastructure.

Qualifications

• Extensive hands-on experience operating GPU clusters in production.
• Proficiency in Kubernetes and AWS is required.

Responsibilities

• Own end-to-end GPU and cloud infrastructure to power real-time AI agents.
• Provision clusters and manage Kubernetes environments.
• Optimize inference workloads for scalability and reliability.

Skills

GPU Infrastructure

Kubernetes

AWS

Distributed Systems

Cloud Provisioning

Model Serving

EKS

Multi-cloud Strategy

Infrastructure as Code

Machine Learning Infrastructure

Job description

Jack & Jill is seeking a Senior GPU Platform Engineer to own the end-to-end GPU and cloud infrastructure powering real-time AI agents. You will provision clusters, manage Kubernetes environments, and optimize inference workloads for scalability and reliability.

The role requires deep hands-on experience operating GPU clusters in production, along with strong proficiency in Kubernetes and AWS to support a startup-ready ML infrastructure.