Infra Architect

NTT Data Americas, Inc.; Concord (CA); On-site; USD 96,000 - 110,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Dental insurance

Vision insurance

Employee assistance program

Job summary

NTT DATA seeks a senior architect in Concord, CA to lead architecture for our GenAI and AI platforms, model serving, governance, and cross-functional initiatives. You will shape multi-cloud, OpenShift/Kubernetes deployments, capacity planning, and high-availability strategies.

Ideal candidates have 10+ years in software engineering/architecture, 5+ years building cloud-native platforms, and deep AI/ML platform knowledge in GenAI, MLOps, and RAG architectures.

Qualifications

• 10 years of software engineering, infrastructure, and architecture experience.
• 5 years designing large-scale cloud-native platforms.
• Strong experience with Kubernetes/OpenShift and distributed systems.
• Deep understanding of Generative AI, RAG, Agentic AI, Model Serving, MLOps.
• Experience designing highly available Tier-1 production systems.

Responsibilities

• Lead architecture and technical direction for Enterprise GenAI and AI platforms.
• Drive design across multi-cloud and on-prem environments and governance frameworks.

Skills

Kubernetes/OpenShift

Distributed systems

Cloud architectures

AI/ML platforms

API platforms

Data platforms

Generative AI

RAG architectures

Job description

Company Overview

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us. We are currently seeking a professional to join our team in Concord, California (US-CA), United States (US). The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.

Lead architecture and technical direction for:

• Enterprise GenAI Platform
• Agentic AI Platform
• Model Serving Infrastructure
• Prompt and Evaluation Frameworks
• AI Governance and Guardrails
• Agent Runtime Platforms
• Observability and AI Operations
• Multi-Cloud AI Platform

Design and drive architecture across:

• OpenShift AI / RHOAI
• GCP Vertex AI
• Gemini Models
• Azure AI Foundry
• AWS Bedrock
• Anthropic Claude
• OpenAI
• Platform Scalability & Resiliency

Lead initiatives involving:

• Capacity planning
• GPU platform strategy
• NVIDIA Super POD architecture
• Multi-region resiliency
• Cloud DR strategy
• Active-active platform architectures
• High availability and disaster recovery

Required Qualifications

• 10 years of software engineering, Infrastructure, and architecture experience.
• 5 years designing large-scale cloud-native platforms.
• Strong experience with Kubernetes/OpenShift, Distributed systems, Cloud architectures, AI/ML platforms, API platforms, Data platforms.
• Deep understanding of Generative AI, RAG architectures, Agentic AI, Model Serving, MLOps.
• Experience designing highly available Tier-1 production systems.

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation, and management of applications, infrastructure, and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

Compensation and Benefits

U.S. On Location / Hybrid NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $70/hr to $80/hr. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications. This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. For our EEO Policy Statement, please click here. If you’d like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.