AI Infrastructure Support Engineer

Neura Market; Northern (KY); Hybrid; USD 160,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Remote work flexibility

Equity

Job summary

Together AI is seeking a Technical Support Engineer to be the first line of defense for customers building training, fine-tuning, and inference pipelines. You will work closely with product and sales, becoming a product expert in Gen AI solutions and ensuring high availability of inference endpoints on Kubernetes.

In this role you will diagnose advanced issues, collaborate across Engineering, Research, and Product, and contribute to infrastructure changes via code.

Qualifications

• 6+ years in a customer-facing technical role, SRE, DevOps, or infrastructure engineering, with at least 1 year in a support role for an AI service.
• Experience as an SRE or DevOps engineer with Kubernetes.
• Strong background in AI, ML, GPU technologies and their HPC integration.
• Advanced infrastructure as code and container infra experience; familiar with observability tooling at scale.

Responsibilities

• Engage with customers to resolve complex technical challenges across GPU clusters and fine-tuning/inference services.
• Serve as customer-facing SRE to maintain healthy, stable, and performant endpoints on Kubernetes.
• Become a product expert in Gen AI solutions and escalate issues to Engineering/Product as needed.
• Assist with hardware and platform migrations; validate system health and traffic routing; monitor dashboards for anomalies.

Skills

Kubernetes

Python

TypeScript

JavaScript

Prometheus

Grafana

REST API

HTTP semantics

LLM inference

LoRA fine-tuning

Infrastructure as Code

Git workflows

GPU cluster management

AWS

GCP

Azure

Tools

Ansible

SLURM

NFS storage

Infra-as-code tooling

Job description

Together AI is seeking a Technical Support Engineer to be the first line of defense for customers building training, fine-tuning, and inference pipelines. You will work closely with product and sales, becoming a product expert in Gen AI solutions and ensuring high availability of inference endpoints on Kubernetes.

In this role you will diagnose advanced issues, collaborate across Engineering, Research, and Product, and contribute to infrastructure changes via code.