Lead Infrastructure Architect, AI & Multi-Cloud

NTT DATA North America; Concord (CA); Hybrid; USD 121,000 - 182,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401k match

Paid time off

Employee assistance

Flexible spending or HSA

Life and AD&D insurance

Disability coverage

Job summary

NTT DATA North America in Concord, CA seeks an Infrastructure Architect to define long-term architecture, influence roadmaps, and lead cross-functional initiatives across multi-cloud AI platforms.

You will lead architecture for OpenShift AI / RHOAI, GCP Vertex AI, Gemini Models, AWS Bedrock and OpenAI, ensuring scalability, governance and high availability.

The role offers hybrid work, a competitive pay range ($121,000–$181,500) and a comprehensive benefits package.

Qualifications

• 10+ years of software engineering, infrastructure and architecture experience.
• 5+ years designing large-scale cloud-native platforms.
• Deep knowledge of Kubernetes/OpenShift, distributed systems, cloud architectures, AI/ML platforms.
• Experience with Generative AI, RAG architectures, agentic AI, model serving, and MLOps.
• Experience designing highly available Tier-1 production systems.

Responsibilities

• Define long-term architecture and roadmaps.
• Lead cross-functional initiatives.
• Drive architecture for OpenShift AI / RHOAI across platforms.
• Oversee multi-cloud platforms (GCP Vertex AI, Azure Foundry, AWS Bedrock, OpenAI).
• Plan capacity and platform scalability.
• Ensure high availability and disaster recovery.

Skills

Kubernetes/OpenShift

Distributed systems

Cloud architectures

AI/ML platforms

API platforms

Data platforms

Generative AI

RAG architectures

Agentic AI

Model Serving

MLOps

Tools

OpenShift AI / RHOAI

GCP Vertex AI

Gemini Models

Azure AI Foundry

AWS Bedrock

Anthropic Claude

OpenAI

Job description

NTT DATA North America in Concord, CA seeks an Infrastructure Architect to define long-term architecture, influence roadmaps, and lead cross-functional initiatives across multi-cloud AI platforms.

You will lead architecture for OpenShift AI / RHOAI, GCP Vertex AI, Gemini Models, AWS Bedrock and OpenAI, ensuring scalability, governance and high availability.

The role offers hybrid work, a competitive pay range ($121,000–$181,500) and a comprehensive benefits package.