Senior GPU Infra Engineer - Low-Latency Voice Platform

AethexAI; Indiana (PA); On-site; USD 150,000 - 230,000; Full time

Job summary

AethexAI is building a latency‑aware voice platform and seeks an experienced infrastructure engineer to own GPU‑driven model serving at scale. You will optimize fleets for cost per minute while maintaining strict latency budgets across regions.

Based in London and working on an in‑office team of ~10, you will drive reliability, observability, and fast architectural decisions to keep the pipeline responsive and secure.

Qualifications

• 5+ years running production infrastructure with a focus on latency
• Hands-on GPU inference serving at low latency and GPU fleet cost management
• Experience with Kubernetes, cloud infra (AWS preferred) and infra-as-code

Responsibilities

• Own serving STT, LLM, and TTS model pipelines on GPUs within latency budgets
• Drive cost-per-minute as a core metric
• Ensure reliability, observability, and on-call readiness across the platform
• Maintain security and compliance for a multi-tenant voice system across regions

Skills

Kubernetes

AWS cloud infra

Infra-as-code

GPU inference serving

Cost optimization

Observability

Security & compliance

Multi-tenant systems

Tools

vLLM

Triton

TensorRT-LLM

Job description

AethexAI is building a latency‑aware voice platform and seeks an experienced infrastructure engineer to own GPU‑driven model serving at scale. You will optimize fleets for cost per minute while maintaining strict latency budgets across regions.

Based in London and working on an in‑office team of ~10, you will drive reliability, observability, and fast architectural decisions to keep the pipeline responsive and secure.