On-Site AI Deployment & Infrastructure Engineer

Votee AI; Hong Kong; On-site; HKD 900,000 - 1,300,000; Full time

Job summary

Votee AI is seeking a Forward Deployed Engineer to lead on-site deployments of our AI systems for clients in Hong Kong. You will install, configure, and optimize Votee AI’s platforms directly at regulated client sites, ensuring secure, scalable performance.

The role emphasizes AI model hosting, hardware acceleration, and modern infrastructure with Docker, Kubernetes, and IaC tools. Flexibility for overnight maintenance and strong Cantonese/English communication are required.

Qualifications

• Proven experience as a DevOps/SRE/Forward Deployed Engineer.
• Hands-on experience serving and orchestrating LLMs and AI models (vLLM, Ollama, TensorRT, Triton Inference Server, Hugging Face toolchains).
• Deep experience provisioning and optimizing AI workloads on GPUs/TPUs/NPUs.
• Docker, Kubernetes, Harbor familiarity.
• IaC using Terraform, Pulumi, CloudFormation.
• Experience with vibe coding and multi-agent systems (Agent Swarms).
• Willingness to work irregular hours including overnight deployments.
• Excellent client-facing communication; fluent in Cantonese and English; Mandarin a plus.

Responsibilities

• On-site implementation: lead end-to-end installation, integration, and testing at client sites.
• AI model deployment & hardware optimization: deploy, serve, and scale LLMs; optimize accelerators for speed.
• Mission-critical deployments: execute during strict maintenance windows with minimal risk.
• Modern infrastructure: containerize and deploy applications using Docker, Harbor, Kubernetes.
• IaC: automate provisioning with Terraform, Pulumi, AWS CloudFormation.
• AI-driven engineering: use vibe coding and multi-agent systems for rapid on-site prototyping and monitoring.
• Security & compliance: ensure infrastructure meets Hong Kong regulatory standards.

Skills

AI/LLM infrastructure

Client-facing communication

On-site deployment

Irregular hours flexibility

Tools

Docker

Harbor

Kubernetes

Terraform

Pulumi

CloudFormation

vLLM

Ollama

TensorRT

Triton Inference Server

Hugging Face toolchains

NVIDIA CUDA

Job description

Votee AI is seeking a Forward Deployed Engineer to lead on-site deployments of our AI systems for clients in Hong Kong. You will install, configure, and optimize Votee AI’s platforms directly at regulated client sites, ensuring secure, scalable performance.

The role emphasizes AI model hosting, hardware acceleration, and modern infrastructure with Docker, Kubernetes, and IaC tools. Flexibility for overnight maintenance and strong Cantonese/English communication are required.