Director-Level SRE for GenAI Platform & Cloud

474 MS Services Group, Inc.; Alpharetta (GA); On-site; USD 125,000 - 195,000; Full time

Job summary

Morgan Stanley Alpharetta seeks an experienced Site Reliability Engineer to join the AI Platform team, supporting GenAI workloads in a regulated financial environment. You will build automation, manage IaC, and ensure reliability across training, inference, and data pipelines.

The role requires strong coding, Kubernetes and cloud experience, plus a track record of driving reliability improvements in large-scale systems. On-site in Alpharetta with cross-team collaboration and on-call duties.

Qualifications

• 5+ years of production experience in SRE / Infrastructure / ops for large-scale systems.
• Strong programming/scripting skills (Python, Go, Java, or equivalent).
• Deep experience with containerization (Docker), orchestration (Kubernetes, etc.).
• Infrastructure-as-code (Terraform, Helm, CloudFormation, Ansible, etc.).
• Familiarity with GPU / AI compute clusters, high-performance data storage, and distributed architectures.
• Experience with monitoring/observability/logging/alerting tools (Prometheus, Grafana, ELK/EFK, Datadog).
• Experience in regulated environments (financial services, compliance, audit, security) is a strong plus.

Responsibilities

• Operate, monitor, and maintain the infrastructure supporting GenAI applications (training, inference, feature store, data ingestion, model serving).
• Design and build automation for core platform capabilities, reducing manual toil.
• Develop and maintain infrastructure-as-code (IaC) for provisioning and managing compute, storage, network, GPU clusters, Kubernetes / container orchestration, etc.
• Establish, monitor, and enforce SLOs/SLIs/SLAs, error budgets, alerting, and dashboards.
• Lead incident response, root cause analysis (RCA), postmortems, and systemic remediation.
• Perform capacity planning, scaling strategies, workload scheduling, and resource forecasting.
• Optimize cost vs. performance tradeoffs in large-scale compute environments.
• Harden systems for security, compliance, auditability, and data governance.
• Collaborate across teams to ensure safe deployment, rollout, rollback, and integration of new systems.

Skills

Python

Go

Java

Kubernetes

Terraform

CI/CD

Prometheus

Grafana

Linux

Networking

Education

Bachelor's or Master’s in CS

Tools

Docker

Kubernetes

Terraform

CloudFormation

OpenTelemetry

Job description

Morgan Stanley Alpharetta seeks an experienced Site Reliability Engineer to join the AI Platform team, supporting GenAI workloads in a regulated financial environment. You will build automation, manage IaC, and ensure reliability across training, inference, and data pipelines.

The role requires strong coding, Kubernetes and cloud experience, plus a track record of driving reliability improvements in large-scale systems. On-site in Alpharetta with cross-team collaboration and on-call duties.