Senior AI Platform Engineer - Remote, High-Impact Infra

PromptCube; Northern (KY); Hybrid; USD 132,000 - 182,000; Full time

Benefits offered by this job

Equity & RSUs

ESPP

Flexible time off

Paid holidays & sick time

Health insurance

Job summary

SentinelOne is seeking a Senior AI Platform Engineer, Infrastructure Services, to own the AI Gateway infrastructure and drive reliability across the platform. You will scale Kong AI Gateway deployments, manage auth, rate limits, and observability, and collaborate with CI/CD, GitOps, and artifact tooling.

You will set technical direction, mentor engineers, and partner with security, DevEx, and product teams while hosting self-hosted models and contributing to LLMOps, cost awareness, and

Qualifications

• 5+ years of experience in platform, infrastructure, or DevOps engineering.
• Experience with API gateway technologies (Kong, Envoy, Apigee, or similar).
• Direct experience with AI/LLM gateway patterns (rate limiting, semantic caching, observability).
• Strong Kubernetes and GitOps experience (ArgoCD or similar).
• CI/CD background with Jenkins pipeline design and administration.
• Experience with artifact and package management systems (Artifactory, Xray) and GitHub Enterprise administration.
• Familiarity with infrastructure-as-code (Terraform) and cloud platforms (AWS/EKS).
• Experience deploying self-hosted LLM inference stacks and GPU-backed infrastructure.

Responsibilities

• Architect, harden, and scale the Kong AI Gateway deployment and related auth, rate limiting, and observability.
• Lead reliability and incident response, including root-cause analysis and remediation.
• Design across the platform, collaborating with CI/CD, GitOps, and artifact tooling teams.
• Evaluate and roll out AI developer tooling and provide build-vs-buy recommendations.
• Set technical direction and mentor other engineers in AI infrastructure.

Skills

Kong API gateway

Kubernetes

GitOps

CI/CD

Jenkins

Artifactory

Okta/OIDC

AI/LLM gateway patterns

GPU scheduling

Terraform

Leadership/mentoring

Tools

ArgoCD

Jenkins

GitHub Enterprise

GitHub Actions

Artifactory

Xray

Terraform

Kubernetes

Job description

SentinelOne is seeking a Senior AI Platform Engineer, Infrastructure Services, to own the AI Gateway infrastructure and drive reliability across the platform. You will scale Kong AI Gateway deployments, manage auth, rate limits, and observability, and collaborate with CI/CD, GitOps, and artifact tooling.

You will set technical direction, mentor engineers, and partner with security, DevEx, and product teams while hosting self-hosted models and contributing to LLMOps, cost awareness, and