AI Systems Design Architect – Vice President

State Street; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

State Street seeks an experienced AI Systems Design Architect (VP) to lead enterprise AI architecture across the GenAI platform stack, partnering with business and engineering teams to define reference architectures, standards, and governance.

You will drive cloud and hybrid AI environments on AWS, Azure, or GCP, ensuring scalable, secure, and compliant designs while mentoring architects and leaders across the organization.

Qualifications

• Bachelor's degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or related; Master’s preferred.
• 12–17 years of experience in solution/enterprise architecture or AI/ML architecture, including leadership of large-scale enterprise initiatives.
• Hands-on and architectural Expertise with Generative AI, LLMs, ML systems, RAG, vector databases, prompt design/orchestration, and AI application integration.
• Proven cloud architecture and enterprise solution design on AWS, Azure, or Google Cloud Platform (GCP).
• Strong understanding of cloud-native architecture including AI/ML services, networking, storage, security, IAM, resilience, and performance optimization.
• Experience designing enterprise-scale, secure, resilient architectures for AI and data-driven applications.
• Expertise in API architecture, microservices, distributed systems, event-driven patterns, enterprise integration, and platform design.
• Knowledge of AI governance, Responsible AI, model risk, compliance, testing, production controls, and control frameworks.
• Understanding of DevSecOps, CI/CD, observability, monitoring, reliability engineering, and platform engineering concepts.
• Ability to lead architecture discussions with senior executives and communicate with technical and non-technical stakeholders.

Responsibilities

• Own enterprise-wide AI system architecture strategy across the full GenAI platform stack.
• Define and govern reference architectures, design standards, and cloud design approaches for AI platforms.
• Provide strategic leadership on scalable, secure, and compliant AI system design.
• Lead architecture decisions for cloud and hybrid AI environments (AWS/Azure/GCP).
• Establish reusable enterprise patterns for RAG, model serving, and prompt orchestration.
• Chair architecture governance forums and align designs to enterprise standards.
• Collaborate with business, product, engineering, cloud, security, risk, data, and operations teams.
• Ensure AI solutions comply with Responsible AI, governance, data controls, and regulatory expectations.
• Drive architecture assessments, due diligence, platform modernization, and production onboarding standards.
• Guide decisions on platform capabilities, build-vs-buy, and modernization opportunities.
• Mentor architects and engineering leaders to improve design quality and adoption of standards.
• Represent Architecture in senior governance and leadership forums.

Skills

Generative AI

LLMs

RAG

Prompt engineering

API architecture

Microservices

Distributed systems

Cloud architecture

DevSecOps

Platform engineering

Education

Bachelor's degree in CS or related

Master's degree preferred

Tools

Databricks

Kubernetes

Vector databases

Prometheus

AWS

Azure

GCP

Job description

AI Systems Design Architect – VP

About The Role

We are seeking an experienced AI System Design Architect (VP) to lead enterprise AI system architecture strategy across the full Generative AI platform stack. This role requires deep expertise in Generative AI, enterprise architecture, platform engineering, distributed systems, and scalable cloud architectures on AWS, Azure, or Google Cloud Platform (GCP).

Key Responsibilities

• Own and drive enterprise-wide AI system architecture strategy across the full GenAI platform stack, including shared services, orchestration layers, model integration, APIs, data flows, and downstream enterprise systems.
• Define and govern reference architectures, design standards, architecture principles, integration patterns, and cloud design approaches for AI platforms and AI-enabled applications.
• Provide strategic technical leadership on scalable, secure, resilient, and compliant AI system design across the organization.
• Lead architecture decisions for cloud and hybrid AI environments on AWS, Azure, or Google Cloud, ensuring interoperability, platform reuse, cost efficiency, and operational excellence.
• Establish reusable enterprise patterns for RAG, model serving, prompt orchestration, agentic AI workflows, AI gateways, and service integration.
• Chair or lead architecture governance forums, reviewing major solution designs, resolving technical trade-offs, and ensuring alignment to enterprise standards.
• Partner closely with business leaders, product teams, engineering, cloud, security, risk, data, and operations teams to align architecture strategy with business priorities.
• Ensure AI solutions comply with Responsible AI, governance, data controls, model risk, testing standards, security requirements, and regulatory expectations.
• Drive architecture assessments, technical due diligence, platform modernization, proof-of-concept direction, and production onboarding standards for AI systems.
• Guide enterprise decisions on platform capabilities, shared services, build‑vs‑buy evaluations, and modernization opportunities.
• Influence and mentor architects and engineering leaders to improve design quality, architectural consistency, and adoption of enterprise AI standards.
• Represent the Architecture function in senior governance and leadership forums.

Required Qualifications

• Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master’s degree preferred.
• 12–17 years of experience in solution architecture, enterprise application architecture, platform architecture, or AI/ML architecture, including leadership of large-scale enterprise initiatives.
• Deep hands‑on and architectural experience with Generative AI, LLMs, ML systems, RAG, vector databases, prompt design/orchestration, and AI application integration.
• Proven expertise in cloud architecture and enterprise solution design on AWS, Azure, or Google Cloud Platform (GCP).
• Strong understanding of cloud‑native architecture including AI/ML services, networking, storage, security, IAM, resilience, and performance optimization.
• Proven experience designing enterprise‑scale, secure, resilient, and high‑performing architectures for AI and data‑driven applications.
• Expertise in API architecture, microservices, distributed systems, event‑driven patterns, enterprise integration, and platform design.
• Strong understanding of AI governance, Responsible AI, model risk, compliance, testing, production controls, and control frameworks.
• Strong understanding of DevSecOps, CI/CD, observability, monitoring, reliability engineering, and platform engineering concepts.
• Demonstrated ability to lead architecture discussions with senior executives and communicate effectively with both technical and non‑technical stakeholders.
• Strong leadership, stakeholder management, problem‑solving, and cross‑functional collaboration skills.

Work Schedule

On‑premise

Keywords

AI Solution Architecture, AI System Design, Enterprise AI Architecture, Generative AI, Machine Learning, LLM, RAG, Vector Databases, Prompt Engineering, Agentic AI, AI Governance, Responsible AI, Enterprise Architecture, Cloud Architecture, AWS, Azure, Google Cloud, GCP, Hybrid Cloud, API Integration, Microservices, Distributed Systems, Event‑Driven Architecture, DevSecOps, CI/CD, Observability, Platform Engineering, MLOps, Databricks, Kubernetes

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work‑life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job ID: R-795829