Senior AI Platform Engineer, Enterprise IT & Guardrails

Coreweave

Sunnyvale (CA)

On-site

USD 182,000 - 242,000

Full time

8 days ago

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with generous match

Tuition Reimbursement

Employee Stock Purchase Program (ESPP)

Flexible PTO

Paid Parental Leave

Catered lunch

Job summary

CoreWeave in Sunnyvale, CA is hiring a Senior AI Platform Engineer to own the design and governance of employee-facing AI tools, from chat assistants to IDEs, with security-first guardrails baked into the platform. You will blend production IT, SRE practices, and hands-on LLM work to enable safe, scalable adoption across the company.

This is a composite role spanning production software, tooling for AI agents, and enterprise IT controls.

Qualifications

6+ years in software engineering, site reliability engineering, or IT systems engineering.
2+ years hands-on experience building with or administering LLM-based products: API integration, prompt and tool design, retrieval pipelines, agent frameworks, multi-agent workflows.
Strong software engineering skills in Python, Go, Rust, or TypeScript.
Experience operating services in production (containers, infrastructure-as-code, CI/CD, secrets management, observability).
Working understanding of enterprise IT control systems: identity and access, endpoint management, SaaS administration.

Responsibilities

Own the end-to-end lifecycle of employee-facing AI platforms across surfaces (web, desktop, mobile, IDE, terminal, browser).
Keep the Platforms in Scope list current as the market moves.
Establish CoreWeave's AI operating framework for IT: intake, standards, runbooks, and enablement content.
Design and implement AI guardrails as enforceable controls with security and IT Identity and Access.
Build and operate connector and MCP allowlists across Okta, Google Workspace, Slack, Atlassian, GitHub, ITSM, and HRIS.
Own the IT-owned control layer for internal chatbots and agents: gateway, identity, secrets, logging, and cost attribution.
Instrument usage, cost, quality, and risk telemetry; build dashboards and alerts for leadership.
Communicate clearly with executives, cross-functional partners, and employees.