VP, Enterprise AI Architect for Audit Platforms

State Street; Clifton (NJ); On-site; USD 120,000 - 218,000; Full time

Benefits offered by this job

401K match

Comprehensive health benefits

Job summary

State Street is seeking an AI Solution Architect, Vice President to lead the AI strategy for Internal Audit. You will shape end‑to‑end AI platforms, drive architectural standards, and oversee production systems with governance, security, and scalability.

Collaboration with data engineering, security, and risk teams is essential to deliver auditable, compliant AI at scale. The role requires deep Generative AI expertise, LLMs, RAG, LangChain, and cloud platforms, with a hands‑on leadership style

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
• 10+ years of experience designing and delivering enterprise software or data platforms, with 3+ years focused on AI / ML solutions
• Hands‑on experience with large language models and modern AI frameworks (prompt engineering, embeddings, RAG, agents)
• Strong background in cloud platforms (Azure or AWS) and microservices‑based architectures
• Experience operationalizing AI systems with MLOps / LLMOps tooling and practices
• Solid understanding of data engineering, APIs, and distributed systems
• Proven ability to design systems with security, privacy, and regulatory considerations

Responsibilities

• Lead end‑to‑end architecture for AI‑enabled platforms supporting Internal Audit
• Define scalable architectural patterns for conversational assistants and predictive analytics
• Act as the technical authority for AI architecture within Internal Audit Technology
• Lead design and implementation of AI orchestration frameworks for multi‑step reasoning
• Architect solutions using LangChain and cloud‑native capabilities
• Design workflows including RAG, guardrails, and hallucination mitigation
• Define and own model selection, evaluation, and benchmarking frameworks
• Lead delivery of production‑ready AI systems including APIs and pipelines
• Establish and mature LLMOps / MLOps practices with monitoring and cost controls
• Ensure platforms meet enterprise standards for availability, performance, and resilience
• Embed AI governance and model risk management into system design
• Implement safeguards for privacy, security, bias detection, and auditability
• Partner with Audit, Risk, Compliance, and Legal to align with policies
• Translate audit and risk challenges into high‑impact AI use cases
• Guide PoCs with a clear path to production
• Stay current on emerging AI technologies and adoption strategies

Skills

Generative AI

LLMs

RAG

AI orchestration

LangChain

Education

Bachelor’s degree in Computer Science, Engineering, Data Science, or related field

10+ years of experience designing and delivering enterprise software or data platforms, with 3+ years focused on AI / ML solutions

Tools

LangChain

Azure/AWS cloud platforms

MLOps tooling

Job description

State Street is seeking an AI Solution Architect, Vice President to lead the AI strategy for Internal Audit. You will shape end‑to‑end AI platforms, drive architectural standards, and oversee production systems with governance, security, and scalability.

Collaboration with data engineering, security, and risk teams is essential to deliver auditable, compliant AI at scale. The role requires deep Generative AI expertise, LLMs, RAG, LangChain, and cloud platforms, with a hands‑on leadership style