Staff Infrastructure Engineer — Enterprise AI & Multi-Cloud

Scale AI, Inc.; New York (NY); On-site; USD 252,000 - 315,000; Full time

Benefits offered by this job

Health, dental and vision coverage

Retirement benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. is seeking a Senior or Staff Infrastructure Engineer to lead the deployment standards for Agentic workflows across multiple clouds.

You will architect scalable infrastructure, drive observability, and mentor teams while delivering hands‑on results. You will work across AWS/Azure/GCP with a focus on security, data isolation, and compliance, shaping the long‑term technical strategy for critical systems at Scale.

Qualifications

• 5+ years of full‑time software engineering experience.
• Deep understanding of CI/CD, IaC (Terraform, Helm Charts), Kubernetes, and observability platforms.
• Extensive experience with at least one major cloud provider (AWS, Azure, or GCP).
• Strong knowledge of security and compliance in enterprise environments.
• Proficiency in Python or JavaScript/TypeScript, and SQL.
• Bonus: hands‑on experience with Agents, LLMs, vector databases and related AI tech.

Responsibilities

• Architect multi‑cloud systems and abstractions for the SGP platform atop cloud providers.
• Analyze logs and metrics to identify areas for improvement.
• Define patterns to support secure, reliable, and scalable Agentic workflows.
• Improve CI/CD processes, test frameworks, data quality, end‑to‑end reconciliation, and anomaly detection.
• Collaborate with platform and product teams to build scalable infrastructure.
• Design and champion scalable, reliable, low‑latency infrastructure for multi‑agent systems at scale.
• Lead the infrastructure roadmap with emphasis on compliance, privacy, and security, including data isolation strategies.
• Own development and maintenance of the Agentic observability platform (logs, metrics, tracing, analytics).
• Drive developer efficiency with IaC tooling across engineering.

Skills

5+ years of software eng

CI/CD

IaC

Kubernetes

Observability

Datadog

Prometheus

Grafana

Terraform

Helm Charts

Cloud providers (AWS/Azure/GCP)

Security & Compliance

Python

JavaScript/TypeScript

SQL

Agents/LLMs/Vectors

Tools

Terraform

Helm Charts

Kubernetes

Datadog

Prometheus

Grafana

Job description

Scale AI, Inc. is seeking a Senior or Staff Infrastructure Engineer to lead the deployment standards for Agentic workflows across multiple clouds.

You will architect scalable infrastructure, drive observability, and mentor teams while delivering hands‑on results. You will work across AWS/Azure/GCP with a focus on security, data isolation, and compliance, shaping the long‑term technical strategy for critical systems at Scale.