AI Infrastructure Engineer

Axiom Global Technologies; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

Axiom Global Technologies seeks an AI Infrastructure Engineer to own GPU fleets, model serving, and Kubernetes clusters in the US and India. You will drive deployment paths, reliability, and cloud cost controls while maintaining on-call ownership of critical services.

Ideal candidates have deep CUDA/GPU fundamentals, vLLM production experience, and strong Python/Shell skills. Expertise in Azure AKS, Prometheus/Grafana, and PostgreSQL is highly valued.

Qualifications

• GPU-backed model inference running in production on Kubernetes with on-call ownership.

Responsibilities

• Owns the GPU fleet, model serving, the Kubernetes clusters in the US and India, the deploy path, reliability, and cloud cost.

Skills

GPU inference in prod

Kubernetes

Python

Shell

Terraform IaC

On-call ownership

vLLM

PyTorch

Prometheus Grafana

Azure AKS

Tools

Nsight

CUDA toolkit

PostgreSQL

CI/CD

Docker

KEDA

Job description

Role & responsibilities :

AI Infrastructure Engineer

Owns the GPU fleet, model serving, the Kubernetes clusters in the US and India, the deploy path, reliability, and cloud cost.

Must have

• GPU-backed model inference run in production on Kubernetes, with on-call ownership of that service.
• vLLM in production: tuned under real load, quantized models (AWQ or similar), concurrency and context-length limits, and upgrades rolled out without an outage.
• CUDA and GPU fundamentals: the memory model, profiling with Nsight or equivalent, reading a utilization graph or an out-of-memory error and knowing what happened, and managing the driver, CUDA toolkit, PyTorch, and vLLM version matrix.
• Kubernetes at depth: GPU node pools, scheduling, device plugins, autoscaling (KEDA or equivalent), and persistent volumes for model caches.
• Ownership of the CI/CD path from build to cluster: container builds, registries, and immutable image tags.
• Azure in production, ideally AKS with GPU node pools, including quota, SKU availability by region, and VNet networking. Deep AWS or GCP experience is acceptable.
• Observability: Prometheus and Grafana, alert design, and a record of turning incidents into alerts.
• PostgreSQL operations: pooling, migrations under load, replication or failover.
• Strong Python and shell. Terraform or equivalent infrastructure as code.
• Fluent written and spoken English. Works autonomously with clean, reviewable pull requests.