On-Prem AI Infrastructure Engineer (Kubernetes + GPUs)

Pursuit Talent Advisory

Austin (TX)

On-site

USD 150,000 - 210,000

Full time

5 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Pursuit Talent Advisory is partnering with an early growth-stage company building AI systems for industrial environments. The engineer will own on-prem deployment, run reliability on constrained hardware, and ensure repeatable releases onto customer hardware with VPN constraints.

Expect to write application code, contribute to integration with cloud dev/staging, and own CI/CD, GPU inference, and hardened security practices. Work is hands-on and autonomous in a small, AI-native team.

Qualifications

  • Strong Kubernetes fundamentals including StatefulSets, storage, networking, ingress, and debugging.
  • Infrastructure as code in production (Terraform or equivalent).
  • Docker with multi-service builds and registry workflows.
  • CI/CD pipelines ownership and maintenance.
  • Experience deploying AI workloads on GPUs with private hardware.
  • Linux/ Bash proficiency and ability to read/write Python.

Responsibilities

  • Own the on-prem deployment path and ensure reliability on single-node and small multi-node setups.
  • Own GitOps with declarative reconciliation, image pinning, and rollback boundaries.
  • Own cloud dev/staging infrastructure as code and promote through environments.
  • Own CI/CD pipelines for multi-service builds and environments that teardown automatically.
  • Own GPU inference layer with model/quantization choices and latency targets.
  • Improve operability with runbooks, telemetry, and secure separation of components.
  • Reduce toil by automating deployment steps and delegating to agents.

Skills

Kubernetes fundamentals
Terraform
Docker
CI/CD ownership
Linux Bash
Python
nvidia-smi readouts
On-prem hardware

Tools

GitOps (Flux/Argo CD)
GPU inference server (vLLM/TGI/TensorRT-LLM)

Job description

Pursuit Talent Advisory is partnering with an early growth-stage company building AI systems for industrial environments. The engineer will own on-prem deployment, run reliability on constrained hardware, and ensure repeatable releases onto customer hardware with VPN constraints.

Expect to write application code, contribute to integration with cloud dev/staging, and own CI/CD, GPU inference, and hardened security practices. Work is hands-on and autonomous in a small, AI-native team.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Infrastructure Engineer - AI, Kubernetes & Edge Systems
Infrastructure Engineer - AI, Kubernetes & Edge Systems

UMATR • Austin (TX)

On-site
USD 120,000 - 190,000
Senior Kubernetes Engineer: GPU AI Infra Platform
Senior Kubernetes Engineer: GPU AI Infra Platform

GTN Technical Staffing • Dallas (TX)

On-site
USD 150,000 - 210,000
Kubernetes & AI Infra Engineer — On-Prem & Cloud
Kubernetes & AI Infra Engineer — On-Prem & Cloud

Discernis • New York (NY)

On-site
USD 150,000 - 190,000
Senior AI Infrastructure Engineer — Kubernetes & GPU
Senior AI Infrastructure Engineer — Kubernetes & GPU

Seekr • Austin (TX)

Hybrid
USD 180,000 - 240,000
Equity ownership
Unlimited PTO
14 holidays
+4
Edge AI Infrastructure Engineer – Kubernetes & GPU
Edge AI Infrastructure Engineer – Kubernetes & GPU

UMATR • Austin (TX)

On-site
USD 120,000 - 190,000
Remote AI Platform Engineer — Kubernetes & GPU, Equity
Remote AI Platform Engineer — Kubernetes & GPU, Equity

Hamilton Barnes Associates Limited • San Francisco (CA)

On-site
USD 250,000 - 300,000
Meaningful equity
Fully remote across North America
Full insurance coverage for you and你的依
GPU-Enabled AI Infrastructure Engineer (Kubernetes)
GPU-Enabled AI Infrastructure Engineer (Kubernetes)

ITCAPS LLC • St. Louis (MO)

On-site
USD 140,000 - 200,000
Lead AI Infrastructure Engineer: Kubernetes & GPU
Lead AI Infrastructure Engineer: Kubernetes & GPU

Seekr • Washington

Hybrid
USD 180,000 - 230,000
Equity ownership
Unlimited PTO
Hybrid work (Reston, VA & Austin, TX)
Remote: AI Factory Infra Architect | GPU & Kubernetes
Remote: AI Factory Infra Architect | GPU & Kubernetes

NVIDIA Corporation • United States

On-site
USD 152,000 - 288,000
Equity
AI Infrastructure Engineer — GPU Kubernetes for Production
AI Infrastructure Engineer — GPU Kubernetes for Production

vCluster • Germany (OH)

On-site
USD 150,000 - 200,000
Competitive Salary
Platinum-Level Insurance
Flexible Working Schedule
+1