Remote AI Inference Support Engineer (SRE)

Together AI; United States; Remote; USD 160,000 - 230,000; Full time

Job summary

Together AI is seeking a Technical Support Engineer to be the first line of defense for customers building training, fine-tuning, and inference solutions. You will work with GPU clusters, Kubernetes-based endpoints, and Gen AI services, ensuring reliability and rapid issue resolution.

The role demands 6+ years in a customer-facing technical capacity, strong SRE/DevOps skills, and deep knowledge of AI/ML infra.

Qualifications

• 6+ years in a customer-facing technical role, SRE, DevOps, or infra engineering with AI service experience.
• Hands-on Kubernetes, cloud, and HPC environments.
• Strong knowledge of AI/ML, GPU tech, and distributed systems.
• Experience with infra-as-code and observability tooling at scale.

Responsibilities

• Engage with customers to resolve complex technical challenges on GPU clusters, inference and fine-tuning services.
• Maintain healthy, stable Inference endpoints running on Kubernetes; prevent degradation.
• Become a product expert for Gen AI solutions and escalate to Engineering when needed.
• Validate system health during migrations and monitor dashboards for anomalies.

Skills

Kubernetes

SRE

DevOps

GPU/AI technologies

Observability (Prometheus/Grafana)

REST API debugging

IaC (Git-based workflows)

Cloud platforms (AWS/GCP/Azure)

HPC environments

Cross-functional collaboration

Tools

Ansible

Prometheus

Grafana

Kubernetes tooling

SLURM

NFS storage

Git workflows

Job description

Together AI is seeking a Technical Support Engineer to be the first line of defense for customers building training, fine-tuning, and inference solutions. You will work with GPU clusters, Kubernetes-based endpoints, and Gen AI services, ensuring reliability and rapid issue resolution.

The role demands 6+ years in a customer-facing technical capacity, strong SRE/DevOps skills, and deep knowledge of AI/ML infra.