Infra Architect

NTT DATA North America; Concord (CA); Hybrid; USD 96,000 - 110,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k plan

HSA / FSA options

AD&D insurance

Job summary

NTT DATA North America seeks a senior architect to define long-term architecture for GenAI platforms and governance in Concord, CA. You will influence roadmaps and lead cross-functional initiatives across OpenShift, AWS Bedrock, Anthropic Claude, and OpenAI.

The role emphasizes capacity planning, multi-region resiliency, and high availability, with the opportunity to shape enterprise AI platform strategy in a hybrid work setting.

Qualifications

• 10 years of software engineering, infrastructure, and architecture experience.
• 5 years designing large-scale cloud-native platforms.
• Strong experience with Kubernetes/OpenShift and distributed systems.
• Deep understanding of Generative AI, RAG, and MLOps.
• Experience designing highly available Tier-1 production systems.

Responsibilities

• Lead architecture and technical direction for Agentic AI Platform and related domains.
• Design and drive architecture across OpenShift AI / RHOAI, AWS Bedrock, and major AI platforms.
• Lead initiatives in capacity planning, multi-region resiliency, and cloud DR strategy.
• Oversee high availability, disaster recovery, and platform scalability & resiliency.
• Coordinate cross-functional teams to align roadmaps and governance.

Skills

Kubernetes/OpenShift

Distributed systems

Cloud architectures

AI/ML platforms

API platforms

Data platforms

Generative AI

RAG architectures

Model Serving

MLOps

Tools

OpenShift AI

AWS Bedrock

GCP Vertex AI

Azure AI Foundry

Anthropic Claude

OpenAI

Job description

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, We are currently seeking a professional to join our team in Concord, California (US-CA), United States (US).

The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.

Lead architecture and technical direction for:

• Agentic AI Platform
• Model Serving Infrastructure
• Prompt and Evaluation Frameworks
• AI Governance and Guardrails
• Agent Runtime Platforms
• Observability and AI Operations

Design and drive architecture across:

• OpenShift AI / RHOAI
• AWS Bedrock
• Anthropic Claude
• OpenAI
• Platform Scalability & Resiliency

Lead initiatives involving:

• Capacity planning
• NVIDIA Super POD architecture
• Multi-region resiliency
• Cloud DR strategy
• High availability and disaster recovery

Company Overview

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, We are currently seeking a professional to join our team in Concord, California (US-CA), United States (US).

The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.

Lead architecture and technical direction for:

• Enterprise GenAI Platform
• Agentic AI Platform
• Model Serving Infrastructure
• Prompt and Evaluation Frameworks
• AI Governance and Guardrails
• Agent Runtime Platforms
• Observability and AI Operations
• Multi-Cloud AI Platform

Design and drive architecture across:

• OpenShift AI / RHOAI
• GCP Vertex AI
• Gemini Models
• Azure AI Foundry
• AWS Bedrock
• Anthropic Claude
• OpenAI
• Platform Scalability & Resiliency

Lead initiatives involving:

• Capacity planning
• GPU platform strategy
• NVIDIA Super POD architecture
• Multi-region resiliency
• Cloud DR strategy
• Active-active platform architectures
• High availability and disaster recovery

Required Qualifications

• 10 years of software engineering, Infrastructure, and architecture experience.
• 5 years designing large-scale cloud-native platforms.
• Strong experience with Kubernetes/OpenShift, Distributed systems, Cloud architectures, AI/ML platforms, API platforms, Data platforms.
• Deep understanding of Generative AI, RAG architectures, Agentic AI, Model Serving, MLOps.
• Experience designing highly available Tier-1 production systems.

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation, and management of applications, infrastructure, and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

Compensation and Benefits

U.S. On Location / Hybrid NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $70/hr to $80/hr. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications. This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. For our EEO Policy Statement, please click here. If you’d like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.