AI Platform Engineer for Kubernetes & LLMs

INTEGRATION APPLIANCE, INC.; United States; Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

Complimentary lunches

Fully stocked kitchens

Wellness program

Volunteer time off

Job summary

Intapp seeks a Platform Engineer to operate a Kubernetes-based AI workload platform, manage access to cloud-hosted foundation models, and deliver IaC with GitOps practices. You’ll build observability, handle GPU inference workloads, and harden security through policies and audits.

Collaboration with product teams and fostering a compliant, multi-tenant environment are key. You’ll work across Azure/AWS, implement MCP protocols, and contribute to a modern, scalable AI infrastructure used by top

Qualifications

• 3+ years in platform, DevOps, SRE, or cloud engineering.
• Hands-on Kubernetes deployments, networking, and troubleshooting.
• Terraform IaC and GitOps tools (Argo CD, Flux).
• Experience with Azure or AWS.
• Observability with OpenTelemetry, Prometheus, Grafana.
• Scripting in Python/Go/Bash and CI/CD experience.
• Nice to have LLM gateways, proxies, observability tools.
• Familiarity with managed model services from cloud providers.
• Understanding of MCP and agent frameworks.
• GPU workloads or model inference serving.
• Experience in multi-tenant, regulated environments.

Responsibilities

• Operate and evolve a Kubernetes-based platform for AI workloads.
• Integrate and manage access to cloud-hosted foundation models across providers.
• Deliver infrastructure as code and GitOps workflows.
• Build monitoring, alerting, and tracing for AI workloads.
• Help design and prototype self-hosted model serving including GPU workloads.
• Harden the platform with secrets management, network policies, authentication, authorization, and audit logging.
• Support internal product teams through documentation, onboarding, and troubleshooting.

Skills

Kubernetes

Terraform

Argo CD

Azure/AWS

Observability

Python/Go/Bash

LLM gateways/observability

Managed cloud services

MCP/agent frameworks

GPU workloads

Multi-tenant/compliance

Tools

Terraform

Argo CD

Flux

OpenTelemetry

Prometheus

Grafana

Job description

Intapp seeks a Platform Engineer to operate a Kubernetes-based AI workload platform, manage access to cloud-hosted foundation models, and deliver IaC with GitOps practices. You’ll build observability, handle GPU inference workloads, and harden security through policies and audits.

Collaboration with product teams and fostering a compliant, multi-tenant environment are key. You’ll work across Azure/AWS, implement MCP protocols, and contribute to a modern, scalable AI infrastructure used by top