Senior AI Platform Engineer: Secure, Scalable LLM Infra

SentinelOne; United States; Hybrid; USD 184,000 - 253,000; Full time

Benefits offered by this job

Restricted Stock Units (RSUs)

Employee Stock Purchase Plan (ESPP)

Flexible time off

Paid company holidays

401(k) retirement plan with company 2%

Job summary

SentinelOne is seeking a Senior Staff AI Platform Engineer to build and operate the enterprise AI platform, including the AI Gateway, Harness, and semantic layers used by internal AI use cases.

You will write production code, ensure security and scalability, and work with the Enterprise AI Platform Engineering team to move architecture from design to running infrastructure. The role emphasizes Python, FastAPI, and integration with major AI providers.

Qualifications

• Hands-on experience building production services in front of multiple consumers (API gateway/internal platform).
• Experience with authentication/authorization, rate limiting, observability, or audit logging.
• AI/LLM platform experience is a strong plus but not required.
• Experience with agent orchestration frameworks (LangGraph or equivalent).
• Familiarity with model providers like AWS Bedrock or Google Vertex.
• 8+ years of professional software engineering experience in AI/ML infra.

Responsibilities

• Design, build, and operate components of the AI Gateway including centralized identity and authentication/authorization, token budgeting, DLP rules, multi-model routing, allow‑listing, and audit logging.
• Build and maintain the Harness layer including agent orchestration, prompt construction, memory/state across multi-turns, and model abstraction across providers (AWS Bedrock, Google Vertex).
• Develop production services in Python (FastAPI) and pydantic.ai; contribute to React/TypeScript surfaces for internal teams.
• Implement MCP/tool wiring ensuring policy controls for all callers.
• Contribute to Claude and Gemini Enterprise plugin framework, build and test role-based skills and agents.
• Instrument platform for observability (metrics, tracing, audits) and participate in on-call support.
• Write technical docs and participate in architecture/code reviews for quality and security.
• Collaborate with Enterprise Data, Enterprise Apps, Product Development, and Infosec to integrate with governed data sources.

Skills

API gateway

Auth & auditing

AI/LLM platform

Python (FastAPI)

TypeScript/React

Observability

DevOps for AI platform

Tools

LangGraph

AWS Bedrock

Google Vertex

FastAPI

pydantic.ai

React

TypeScript

Job description

SentinelOne is seeking a Senior Staff AI Platform Engineer to build and operate the enterprise AI platform, including the AI Gateway, Harness, and semantic layers used by internal AI use cases.

You will write production code, ensure security and scalability, and work with the Enterprise AI Platform Engineering team to move architecture from design to running infrastructure. The role emphasizes Python, FastAPI, and integration with major AI providers.