Infra Architect

Creative Solutions Services, LLC; Concord (CA); On-site; USD 96,000 - 110,000; Full time

Benefits offered by this job

Medical, dental and vision insurance

401(k) plan

AD&D insurance

Employee assistance program

HSA/ Flexible spending account

Job summary

NTT DATA seeks a senior leader to define and drive architecture for enterprise GenAI platforms in Concord, CA. You will influence roadmaps, lead cross-functional teams, and steward AI governance and platform scalability.

The role requires deep expertise in cloud-native architectures, AI/ML platforms, and production-ready systems. Hybrid on-site work in Concord with broad cross-cloud responsibilities is expected.

Qualifications

• 10 years of software engineering, infrastructure, and architecture experience.
• 5 years designing large-scale cloud-native platforms.
• Strong experience with Kubernetes/OpenShift, distributed systems, cloud architectures, AI/ML platforms, API platforms, Data platforms.
• Deep understanding of Generative AI, RAG architectures, Agentic AI, Model Serving, MLOps.
• Experience designing highly available Tier-1 production systems.

Responsibilities

• Define and lead architecture for GenAI platforms and AI governance.
• Drive multi-cloud platform design (OpenShift AI, Vertex AI, Gemini, Azure AI Foundry, AWS Bedrock).
• Oversee capacity planning, GPU platform strategy, and high-availability architectures.
• Ensure production systems are scalable, observable, and DR-ready.
• Collaborate with cross-functional teams to influence roadmaps.

Skills

Kubernetes/OpenShift

Distributed systems

Cloud architectures

AI/ML platforms

API platforms

Data platforms

Generative AI

RAG architectures

Agentic AI

Model Serving

MLOps

Software engineering

Job description

Company Overview

Req ID: 389650 NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us.

We are currently seeking a professional to join our team in Concord, California (US-CA), United States (US).

The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.

Lead architecture and technical direction for:

• Enterprise GenAI Platform
• Agentic AI Platform
• Model Serving Infrastructure
• Prompt and Evaluation Frameworks
• AI Governance and Guardrails
• Agent Runtime Platforms
• Observability and AI Operations
• Multi-Cloud AI Platform

Design and drive architecture across:

• OpenShift AI / RHOAI
• GCP Vertex AI
• Gemini Models
• Azure AI Foundry
• AWS Bedrock
• Anthropic Claude
• OpenAI
• Platform Scalability & Resiliency

Lead initiatives involving:

• Capacity planning
• GPU platform strategy
• NVIDIA Super POD architecture
• Multi-region resiliency
• Cloud DR strategy
• Active-active platform architectures
• High availability and disaster recovery

Required Qualifications

• 10 years of software engineering, Infrastructure, and architecture experience.
• 5 years designing large-scale cloud-native platforms.
• Strong experience with Kubernetes/OpenShift, Distributed systems, Cloud architectures, AI/ML platforms, API platforms, Data platforms.
• Deep understanding of Generative AI, RAG architectures, Agentic AI, Model Serving, MLOps.
• Experience designing highly available Tier-1 production systems.

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation, and management of applications, infrastructure, and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

Compensation and Benefits

U.S. On Location / Hybrid NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $70/hr to $80/hr. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications. This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. For our EEO Policy Statement, please click here. If you’d like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.