Senior Software Engineer at Tavus

Jack & Jill; San Francisco (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Jack & Jill is seeking a Senior GPU Platform Engineer to own the end-to-end GPU and cloud infrastructure powering real-time AI agents. You will provision clusters, manage Kubernetes environments, and optimize inference workloads for scalability and reliability.

The role requires deep hands-on experience operating GPU clusters in production, along with strong proficiency in Kubernetes and AWS to support a startup-ready ML infrastructure.

Qualifications

• Extensive hands-on experience operating GPU clusters in production.
• Proficiency in Kubernetes and AWS is required.

Responsibilities

• Own end-to-end GPU and cloud infrastructure to power real-time AI agents.
• Provision clusters and manage Kubernetes environments.
• Optimize inference workloads for scalability and reliability.

Skills

GPU Infrastructure

Kubernetes

AWS

Distributed Systems

Cloud Provisioning

Model Serving

EKS

Multi-cloud Strategy

Infrastructure as Code

Machine Learning Infrastructure

Job description

Own the end-to-end GPU and cloud infrastructure to power real-time AI agents. This includes provisioning clusters, managing Kubernetes environments, and optimizing inference workloads for scalability and reliability.

Requirements: Requires extensive hands-on experience operating GPU clusters in production and deep proficiency in Kubernetes and AWS. Candidates should have a startup-ready mindset and experience with high-performance machine learning infrastructure.

Key Skills: GPU Infrastructure, Kubernetes, AWS, Distributed Systems, Cloud Provisioning, Model Serving, EKS, Multi-cloud Strategy, Infrastructure as Code, Machine Learning Infrastructure