AI Systems Architect

UltaHost

United States

Remote

USD 120,000 - 190,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

UltaHost is seeking an experienced infrastructure/DevOps engineer to design and operate AI-focused infrastructure on GPU-enabled servers. You will craft Proxmox/KVM strategies, deploy and optimize LLMs and RAG apps, and build production AI solutions that integrate with UltaHost platforms and internal tools.

The role requires strong Linux skills, containerization expertise, and 5+ years in infra/DevOps, plus 2–3 years in AI-powered systems. Fluency in English is essential.

Qualifications

  • Strong Linux administration and troubleshooting
  • Hands-on KVM or Proxmox VE virtualization experience
  • Strong Docker and containerization knowledge
  • Practical understanding of GPU, VRAM, quantization and inference performance
  • Experience building and deploying LLM or RAG applications
  • Python or TypeScript/Node.js backend development
  • Networking fundamentals: TCP/IP, DNS, TLS, firewalls, reverse proxies
  • At least 5 years in infrastructure, platform, DevOps or backend systems
  • At least 2-3 years building or operating AI-powered systems
  • Professional working proficiency in English

Responsibilities

  • Design and operate infrastructure for LLM and AI workloads on GPU-enabled servers
  • Design Proxmox, KVM and container virtualization strategies for AI workloads
  • Deploy, benchmark and optimize self-hosted and third-party LLMs
  • Build production AI applications, RAG systems, agents and APIs
  • Integrate AI systems with UltaHost platforms, portals and internal tools
  • Automate infrastructure provisioning and deployment workflows
  • Apply least-privilege, isolation and governance controls to AI systems
  • Identify business workflows where AI or deterministic automation reduces manual work

Skills

Linux admin
KVM/Proxmox
Docker
Containerization
GPU/LLM
Python/TS
Networking
English
DevOps

Tools

Terraform
Ansible
Kubernetes
Prometheus

Job description

Responsibilities
  • Design and operate infrastructure for LLM and AI workloads on GPU-enabled servers
  • Design Proxmox, KVM and container virtualization strategies for AI workloads
  • Deploy, benchmark and optimize self-hosted and third-party LLMs
  • Build production AI applications, RAG systems, agents and APIs
  • Integrate AI systems with UltaHost platforms, portals and internal tools
  • Automate infrastructure provisioning and deployment workflows
  • Apply least-privilege, isolation and governance controls to AI systems
  • Identify business workflows where AI or deterministic automation reduces manual work
Requirements
  • Strong Linux administration and troubleshooting
  • Hands-on KVM or Proxmox VE virtualization experience
  • Strong Docker and containerization knowledge
  • Practical understanding of GPU, VRAM, quantization and inference performance
  • Experience building and deploying LLM or RAG applications
  • Python or TypeScript/Node.js backend development
  • Networking fundamentals: TCP/IP, DNS, TLS, firewalls, reverse proxies
  • At least 5 years in infrastructure, platform, DevOps or backend systems
  • At least 2-3 years building or operating AI-powered systems
  • Professional working proficiency in English
Preferred Qualifications
  • NVIDIA GPU and CUDA ecosystem experience
  • vLLM, Ollama, LiteLLM or Triton experience
  • Vector databases such as Qdrant or pgvector
  • Terraform, Ansible and Kubernetes
  • Observability tooling such as Prometheus, Grafana or OpenTelemetry
About the Company
  • UltaHost is a global web hosting and cloud infrastructure company founded in 2018.
  • It provides VPS, dedicated, shared hosting, domains and cloud services worldwide.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Systems Architect: LLM Infra & GPU Optimization
AI Systems Architect: LLM Infra & GPU Optimization

UltaHost • United States

Remote
USD 120,000 - 190,000
AI Engineer / LLM Systems Engineer
AI Engineer / LLM Systems Engineer

Sphere Software • United States

On-site
USD 120,000 - 170,000
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)

Veear Projects Inc. • Sunnyvale (CA)

On-site
USD 140,000 - 210,000
Principal AI Systems Engineer (Fully Remote)
Principal AI Systems Engineer (Fully Remote)

Highrise AI • United States

Remote
USD 120,000 - 180,000
AI Operations Platform Consultant
AI Operations Platform Consultant

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 190,000
AI Operations Platform Consultant
AI Operations Platform Consultant

Quantum Technologies. LLC • Jersey City (NJ)

Hybrid
USD 120,000 - 165,000
On-Prem LLM Inference Engineer: GPU & AI Infra
On-Prem LLM Inference Engineer: GPU & AI Infra

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
AI Kernel / Cluster Engineer
AI Kernel / Cluster Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 150,000 - 210,000
AI Operations Platform Consultant
AI Operations Platform Consultant

Robotic Technologies Automation • Jersey City (NJ)

On-site
USD 140,000 - 200,000
AI Platform Engineer
AI Platform Engineer

BrothersTech • United States

On-site
USD 140,000 - 200,000