Cloud Platform Engineer

INTEGRATION APPLIANCE; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

INTEGRATION APPLIANCE is seeking a seasoned Platform Engineer to operate a Kubernetes-based AI workloads platform. You will drive IaC, GitOps, and multi-cloud model hosting while ensuring security and observability.

You will collaborate with product teams, implement OpenTelemetry, and optimize costs across AWS/Azure. The role offers a collaborative culture and meaningful impact in a growing team.

Qualifications

• 3+ years in platform, DevOps, SRE, or cloud engineering.
• Hands-on Kubernetes with deployments, networking, and troubleshooting.
• IaC (Terraform) and GitOps tooling (Argo CD, Flux or similar).
• Experience with at least one major cloud (Azure or AWS).
• Observability tools such as OpenTelemetry, Prometheus, Grafana; scripting in Python/Go/Bash; CI/CD experience.

Responsibilities

• Operate and evolve a Kubernetes-based AI workloads platform, including LLM gateways and agent runtimes.
• Integrate and manage access to cloud-hosted foundation models across providers with routing, quotas, fallbacks, cost controls, and isolation.
• Deliver infrastructure as code and GitOps workflows.
• Build monitoring, alerting, and tracing for AI workloads.
• Help design self-hosted model serving, including GPU workloads and inference runtimes.
• Harden the platform with secrets management, network policies, authz, and audit logging.
• Support internal product teams with documentation, onboarding, and troubleshooting.

Skills

DevOps practices

SRE mindset

Multi-cloud experience

Networking troubleshooting

Tools

Kubernetes

Terraform

Argo CD

Flux

OpenTelemetry

Prometheus

Grafana

Python

Go

Bash

CI/CD

Azure

AWS

Job description

What you will do

• Operate and evolve a Kubernetes-based platform for AI workloads, including LLM gateways, agent and tool-integration gateways, and agent runtimes
• Integrate and manage access to cloud-hosted foundation models across multiple providers, covering routing, quotas, fallbacks, cost controls, and tenant isolation
• Deliver infrastructure as code and GitOps workflows
• Build monitoring, alerting, and tracing for AI workloads
• Help design and prototype self-hosted model serving, including GPU workloads and inference runtimes
• Harden the platform with secrets management, network policies, authentication and authorization, and audit logging
• Support internal product teams through documentation, onboarding, and troubleshooting

What you will need

• 3+ years in platform, DevOps, SRE, or cloud engineering
• Hands-on experience with Kubernetes, including deployments, networking, and troubleshooting
• Experience with infrastructure as code (Terraform) and GitOps tooling (Argo CD, Flux, or similar)
• Solid experience with at least one major cloud, Azure or AWS
• Experience with observability tools such as OpenTelemetry, Prometheus, and Grafana
• Scripting and coding skills in Python, Go, or Bash, and CI/CD experience

Nice to have

• Experience with LLM gateways or proxies, or LLM observability and tracing tools
• Familiarity with managed model services from major cloud providers, such as Azure or AWS
• Understanding of agent frameworks and tool-integration protocols such as Model Context Protocol (MCP)
• Experience running GPU workloads or model inference serving
• Experience in multi-tenant, regulated, or compliance-driven environments

What you will gain:

Expand Your Skills: Unlock your potential with professional development opportunities supported by a community of experienced professionals. We offer reimbursement for training and continuing education to help you stay ahead in your career.

Enjoy Where You Work: Thrive in our modern, open offices designed to inspire creativity and collaboration. Our complimentary lunches and fully stocked kitchens ensure you have everything you need to stay energized throughout the day.

Support What Matters Most: Our comprehensive wellness and flexible time off programs and our benefits are designed to care for you and your family. Our family-formation benefits and support during your family-building journey ensure you have the resources you need when it matters most. We believe in giving back and supporting our communities with paid volunteer time off and a donation matching program for the causes you care about.

Join us and be a part of a collaborative and welcoming culture where your contributions are valued, and your professional growth is a priority. Together, we are building a company of long-term value that we can all be proud of.

#Li-GM1

Your actual base salary will be determined by factors such as relevant experience, geographic location, and internal equity. In addition to base salary, variable compensation and equity may also be included.

Intapp provides equal employment opportunities to all qualified applicants and will make hiring decisions without regard to race, color, sex, sexual orientation, gender identity or expression, religion, national origin or ancestry, age, disability, marital status, pregnancy, protected veteran status, protected genetic information, political affiliation, or any other characteristic protected by federal, state or local laws.