Senior AI Platform Engineer — Enterprise IT & Guardrails

AI Chopping Block, Inc.; Sunnyvale (CA); On-site; USD 182,000 - 242,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with employer match

Equity awards

Tuition Reimbursement

Flexible PTO

Catered lunch daily

Job summary

CoreWeave is seeking a Senior AI Platform Engineer to own design, implementation, and governance of employee‑facing AI across the company. You will be the technical owner for AI tools, embedding guardrails at platform level with identity, device, and tenant controls to ensure safe adoption.

This composite role blends production software/SRE, hands-on LLM/agent work, and enterprise IT controls across identity, devices, and SaaS. Expect rapid evolution and cross‑functional collaboration.

Qualifications

• 6+ years in software engineering, SRE, or IT systems engineering.
• 2+ years building or administering LLM-based products and agent work.
• Strong software engineering in Python, Go, Rust, or TypeScript.
• Production experience with CI/CD, secrets management, and observability.
• Understanding of enterprise IT controls: SSO/SCIM, SAML/OIDC, OAuth; device trust and zero trust.
• Proven ability to write clear technical docs and lead cross-functional initiatives.

Responsibilities

• Own end-to-end lifecycle of employee-facing AI platforms across surfaces.
• Maintain Platforms in Scope list as the market moves.
• Establish IT AI operating framework with intake, review, and enablement content.
• Design and implement AI guardrails as enforceable controls with security partners.
• Build connector and MCP allowlists across Okta, Google Workspace, Slack, Atlassian, GitHub.
• Translate acceptable-use and data requirements into technical policy and audits.
• Own IT-controlled layer for internal chatbots and agents: gateway, identity, secrets, and monitoring.
• Manage inference endpoints, agent hosts, and developer AI tooling on managed devices.
• Maintain MCP servers, shared agent configuration, and related standards.
• Maintain SRE standards: automation, reliability targets, on-call, incident response.
• Instrument usage, cost, quality, and risk telemetry; build dashboards for leadership.
• Serve as senior escalation point for AI tooling issues and communicate with executives.
• Collaborate with cross-functional partners and employees on governance and adoption.

Skills

Software engineering

Site Reliability Engineering

IT Systems Engineering

LLM tools experience

Agent frameworks

Python/Go/Rust/TypeScript

CI/CD

Observability

Secrets management

SSO/SCIM

SAML/OIDC/OAuth

Technical documentation

Tools

Okta

Entra ID

Google Workspace

Slack

Atlassian

GitHub

Job description

CoreWeave is seeking a Senior AI Platform Engineer to own design, implementation, and governance of employee‑facing AI across the company. You will be the technical owner for AI tools, embedding guardrails at platform level with identity, device, and tenant controls to ensure safe adoption.

This composite role blends production software/SRE, hands-on LLM/agent work, and enterprise IT controls across identity, devices, and SaaS. Expect rapid evolution and cross‑functional collaboration.