VP, AI Solutions Architect: Enterprise GenAI & Governance

State Street; Boston (MA); On-site; USD 120,000 - 218,000; Full time

Benefits offered by this job

401K with company match

Health insurance

Paid time off

Job summary

State Street seeks an AI Solution Architect, Vice President to lead the AI strategy for Internal Audit, delivering production‑grade AI systems with LLMs, RAG, and enterprise integration. You will guide architecture, orchestration, and governance across data, security, and infrastructure teams.

You will shape scalable patterns for conversational assistants, predictive analytics, and continuous auditing while ensuring explainability, cost control, and risk management across initiatives.

Qualifications

• 10+ years of experience designing and delivering enterprise software or data platforms
• 3+ years focused on AI/ML solutions
• Hands-on with large language models and modern AI frameworks
• Strong cloud experience (Azure or AWS) and microservices architectures
• Experience operationalizing AI systems with MLOps/LLMOps tooling

Responsibilities

• Lead end-to-end AI architecture for enterprise platforms
• Define scalable patterns for conversational assistants, generative insights, and predictive analytics
• Build production-ready AI systems with APIs and orchestration pipelines
• Establish and mature LLMOps / MLOps practices
• Embed governance, risk management, and data security into system design

Skills

Generative AI

LLMs

RAG

LangChain

Architectural leadership

Stakeholder collaboration

Communication

Problem solving

Education

Bachelor's or Master’s in CS/Engineering/Data Science

Tools

LangChain

Cloud-native platforms

APIs

MLOps / LLMOps

Vector databases

Job description

State Street seeks an AI Solution Architect, Vice President to lead the AI strategy for Internal Audit, delivering production‑grade AI systems with LLMs, RAG, and enterprise integration. You will guide architecture, orchestration, and governance across data, security, and infrastructure teams.

You will shape scalable patterns for conversational assistants, predictive analytics, and continuous auditing while ensuring explainability, cost control, and risk management across initiatives.