Senior AI Infrastructure Engineer – Enterprise Cloud

GRAIL

Durham (NC)

Hybrid

USD 147,000 - 224,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Flexible work policy
Competitive benefits package
401(k) with employer match

Job summary

GRAIL is recruiting a Staff Software Development Engineer – Enterprise AI Infrastructure to lead the design, development, and scaling of a centralized AI platform built on AWS EKS. You will architect agentic workflows, secure integrations via MCP, and govern tool executions with IAM, OIDC, and Cedar-style policy controls.

This senior role mentors teams and aligns AI infrastructure with regulatory requirements.

Qualifications

  • Bachelor's degree or equivalent in Computer Science, Software Engineering, AI, Cloud Computing, or related field.
  • ,

Responsibilities

  • Lead end-to-end design, development, deployment, and monitoring of a scalable, governed enterprise AI platform.
  • Design and implement agentic AI workflows and multi-agent systems.
  • Architect and manage secure integrations using MCP for LLMs.
  • Enforce secure, least-privilege tool execution with IAM, OAuth, JWT, and IdPs.
  • Develop isolated, scalable containerized runtimes (Kubernetes pods on EKS).
  • Establish audit trails and observability with AWS CloudTrail and OpenTelemetry.
  • Collaborate with Product, Security, Regulatory, and stakeholders to translate requirements into scalable AI infrastructure.

Skills

AWS
Kubernetes
LangChain
LangGraph
AutoGen
Claude Agent SDK
MCP
OAuth
JWT
Okta
Auth0
Python
TypeScript
Go
Terraform
AWS CDK
Bedrock
OpenSearch
FAISS
pgvector
CI/CD
MLOps
Helm
OpenTelemetry

Education

Bachelor's degree in CS/SE/AI/Cloud Computing

Tools

AWS EKS
Kubernetes networking
VPC
Bedrock
OpenSearch Serverless

Job description

GRAIL is recruiting a Staff Software Development Engineer – Enterprise AI Infrastructure to lead the design, development, and scaling of a centralized AI platform built on AWS EKS. You will architect agentic workflows, secure integrations via MCP, and govern tool executions with IAM, OIDC, and Cedar-style policy controls.

This senior role mentors teams and aligns AI infrastructure with regulatory requirements.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer – Enterprise Cloud
Senior AI Infrastructure Engineer – Enterprise Cloud

Grailbio • Edison (CA)

Hybrid
USD 169,000 - 224,000
Senior AI Infra Engineer for Enterprise Cloud & Agents
Senior AI Infra Engineer for Enterprise Cloud & Agents

Initial Therapeutics, Inc. • Durham (NC)

Hybrid
USD 147,000 - 195,000
Staff AI Infrastructure Engineer, Enterprise Platform
Staff AI Infrastructure Engineer, Enterprise Platform

BioSpace • Durham (NC)

Hybrid
USD 147,000 - 195,000
AI-Driven Forward-Deployed Engineer
AI-Driven Forward-Deployed Engineer

Grailbio • Edison (CA)

Hybrid
USD 86,000 - 121,000
Senior AI Platform Engineer – Enterprise GenAI & Security
Senior AI Platform Engineer – Enterprise GenAI & Security

Jobtailor • California (MO)

On-site
USD 150,000 - 190,000
Staff Infrastructure Engineer — Enterprise AI & Multi-Cloud
Staff Infrastructure Engineer — Enterprise AI & Multi-Cloud

Scale AI, Inc. • New York (NY)

On-site
USD 252,000 - 315,000
Health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
AI Systems Engineer — HealthTech Deployments
AI Systems Engineer — HealthTech Deployments

Initial Therapeutics, Inc. • Menlo Park (CA)

Hybrid
USD 99,000 - 121,000
401(k) match
Medical/Dental/Vision
Flexible time-off
Senior AI Platform Engineer & Technical Lead
Senior AI Platform Engineer & Technical Lead

Nscale • Seattle (WA)

On-site
USD 180,000 - 260,000
Medical insurance
Dental insurance
Vision insurance
+3
Senior AI Engineer — Production-Ready Enterprise AI
Senior AI Engineer — Production-Ready Enterprise AI

Moring AI • Atlanta (GA)

On-site
USD 150,000 - 210,000
Travel up to 30%
Senior AI Systems Engineer — Cloud & ML Infra
Senior AI Systems Engineer — Cloud & ML Infra

MSM Technology • United States

On-site
USD 150,000 - 200,000