Infra Architect - AI Platform & GenAI Infrastructure

Mphasis; Concord (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Mphasis is seeking a proven senior architect to lead the design and direction of our AI Platform, including agentic AI, model serving, and orchestration across leading clouds and providers.

You will drive capacity planning, multi-region resilience, and DR strategies to ensure availability of Tier-1 production systems in a high-growth environment.

Qualifications

• 10+ years of software engineering, infrastructure and architecture experience.

Responsibilities

• Design and drive architecture across OpenShift AI / RHOAI, AWS Bedrock, Anthropic Claude, OpenAI.
• Lead capacity planning and multi-region resiliency initiatives.
• Define platform scalability, reliability, and DR strategies.
• Ensure high availability of Tier-1 production systems.

Skills

Distributed systems

AI/ML platforms

API platforms

Generative AI

Agentic AI

Model Serving

MLOps

Production systems

Job description

Lead architecture and technical direction for:

• Agentic AI Platform
• Model Serving Infrastructure
• Prompt and Evaluation Frameworks
• AI Governance and Guardrails
• Agent Runtime Platforms
• Observability and AI Operations

Responsibilities

Design and drive architecture across:

• OpenShift AI / RHOAI
• AWS Bedrock
• Anthropic Claude
• OpenAI
• Platform Scalability & Resiliency

Lead initiatives involving:

• Capacity planning
• NVIDIA Super POD architecture
• Multi-region resiliency
• Cloud DR strategy
• High availability and disaster recovery

Qualifications

• 10+ years of software engineering, infrastructure and architecture experience.

Required Skills

Strong experience with:

• Distributed systems
• AI/ML platforms
• API platforms

Deep understanding of:

• Generative AI
• Agentic AI
• Model Serving
• MLOps
• Experience designing highly available Tier-1 production systems.