AI Systems Architect: LLM Infra & GPU Optimization

UltaHost

United States

Remote

USD 120,000 - 190,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

UltaHost is seeking an experienced infrastructure/DevOps engineer to design and operate AI-focused infrastructure on GPU-enabled servers. You will craft Proxmox/KVM strategies, deploy and optimize LLMs and RAG apps, and build production AI solutions that integrate with UltaHost platforms and internal tools.

The role requires strong Linux skills, containerization expertise, and 5+ years in infra/DevOps, plus 2–3 years in AI-powered systems. Fluency in English is essential.

Qualifications

  • Strong Linux administration and troubleshooting
  • Hands-on KVM or Proxmox VE virtualization experience
  • Strong Docker and containerization knowledge
  • Practical understanding of GPU, VRAM, quantization and inference performance
  • Experience building and deploying LLM or RAG applications
  • Python or TypeScript/Node.js backend development
  • Networking fundamentals: TCP/IP, DNS, TLS, firewalls, reverse proxies
  • At least 5 years in infrastructure, platform, DevOps or backend systems
  • At least 2-3 years building or operating AI-powered systems
  • Professional working proficiency in English

Responsibilities

  • Design and operate infrastructure for LLM and AI workloads on GPU-enabled servers
  • Design Proxmox, KVM and container virtualization strategies for AI workloads
  • Deploy, benchmark and optimize self-hosted and third-party LLMs
  • Build production AI applications, RAG systems, agents and APIs
  • Integrate AI systems with UltaHost platforms, portals and internal tools
  • Automate infrastructure provisioning and deployment workflows
  • Apply least-privilege, isolation and governance controls to AI systems
  • Identify business workflows where AI or deterministic automation reduces manual work

Skills

Linux admin
KVM/Proxmox
Docker
Containerization
GPU/LLM
Python/TS
Networking
English
DevOps

Tools

Terraform
Ansible
Kubernetes
Prometheus

Job description

UltaHost is seeking an experienced infrastructure/DevOps engineer to design and operate AI-focused infrastructure on GPU-enabled servers. You will craft Proxmox/KVM strategies, deploy and optimize LLMs and RAG apps, and build production AI solutions that integrate with UltaHost platforms and internal tools.

The role requires strong Linux skills, containerization expertise, and 5+ years in infra/DevOps, plus 2–3 years in AI-powered systems. Fluency in English is essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Systems Architect
AI Systems Architect

UltaHost • United States

Remote
USD 120,000 - 190,000
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
Solutions Architect
Solutions Architect

Teqconnect • San Francisco (CA)

On-site
USD 120,000 - 180,000
Remote AI Infra Architect | GPU, Cloud & MLOps
Remote AI Infra Architect | GPU, Cloud & MLOps

Extravs • United States

Remote
USD 95,000 - 155,000
Health, dental, and vision insurance
Paid time off and holidays
Retirement savings benefits
AI Kernel / Cluster Engineer
AI Kernel / Cluster Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 150,000 - 210,000
AI Engineer / LLM Systems Engineer
AI Engineer / LLM Systems Engineer

Sphere Software • United States

On-site
USD 120,000 - 170,000
AI Platform Engineer: GPU Infra & MLOps
AI Platform Engineer: GPU Infra & MLOps

ICE Clear Europe Limited • Georgia

Hybrid
USD 140,000 - 200,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
Solutions Architect
Solutions Architect

Teqconnect • New York (NY)

On-site
USD 120,000 - 190,000
Remote AI Infrastructure Engineer (GPU/MLOps)
Remote AI Infrastructure Engineer (GPU/MLOps)

Software • United States

Remote
USD 95,000 - 155,000
Health, dental, and vision insurance
100% remote work
Flexible working arrangements
+4