Remote Principal AI Platform Engineer: Scale & Governance

Apex Systems; Seattle (WA); Remote; USD 138.000 - 179.000; Vollzeit

Zusammenfassung

Apex Systems seeks a Principal AI Platform Engineer to own and operate an enterprise AI platform, from infrastructure to production. You will lead AI gateway design, GPU-backed model serving, RAG systems, and observability, shaping governance, security, and cost strategies in a highly hands-on role.

You will collaborate with security, ops, and business teams, ensuring safe and efficient AI deployment while maintaining hands-on coding and engineering leadership at the Principal level.

Qualifikationen

• 6+ years of Platform Engineering, Site Reliability Engineering, Infrastructure Engineering, or related technical operations.
• 2+ years running LLM/AI systems in production for real users, or significant ML platform operations experience.
• Hands-on experience implementing and operating an AI/LLM gateway in front of one or more model providers.
• Hands-on experience deploying open-weight models on GPUs using vLLM, NVIDIA Triton/TensorRT-LLM, or similar.

Aufgaben

• Own key components of the enterprise AI platform from infrastructure through production operations.
• Build and operate an AI gateway supporting multiple models/providers, including routing, fallback, security, quotas, and cost allocation.
• Deploy and operate open-weight models on GPU infrastructure.
• Build and operate production RAG systems, including vector stores, embedding pipelines, document processing, retrieval, and governed knowledge sources.
• Establish AI observability and cost management, including token usage, GPU utilization, and platform cost.
• Implement tracing, monitoring, evaluation, and regression testing using Langfuse, LangSmith, Arize, or similar platforms.
• Deploy, monitor, troubleshoot, and support production AI agents and workflows.

Kenntnisse

Python

Terraform

CI/CD

Kubernetes

AKS

Tools

Langfuse

LangSmith

Arize

vLLM

NVIDIA Triton

TensorRT-LLM

Azure APIM

Kong

Jobbeschreibung

Apex Systems seeks a Principal AI Platform Engineer to own and operate an enterprise AI platform, from infrastructure to production. You will lead AI gateway design, GPU-backed model serving, RAG systems, and observability, shaping governance, security, and cost strategies in a highly hands-on role.

You will collaborate with security, ops, and business teams, ensuring safe and efficient AI deployment while maintaining hands-on coding and engineering leadership at the Principal level.