AVP, AI Systems Architecture & GenAI Platform Lead

State Street; Burlington (MA); On-site; USD 90,000 - 158,000; Full time

Benefits offered by this job

401K with company match

Medical, dental, vision

Paid time off

Employee Assistance Program

Performance-based awards

Job summary

State Street seeks an AI System Design Architect (AVP) to own end-to-end design for a major GenAI platform, coordinating with product, engineering, data science, cloud and control teams. You will translate business needs into scalable, secure architectures on AWS/Azure/GCP, define reference patterns, and ensure governance and production readiness across the AI stack.

This role emphasizes security, resiliency, observability, and alignment with enterprise architecture standards while collaborating

Qualifications

• 8–14 years of experience in solution/enterprise architecture or AI/ML architecture
• Hands-on Generative AI, LLMs, ML systems, RAG architectures
• Experience with cloud platforms (AWS/Azure/GCP)
• Strong API architecture, microservices, distributed systems, and integration patterns

Responsibilities

• Own end-to-end architecture and system design for a major AI platform domain, including model integration and data flows
• Define and implement reference architectures, design standards, and non-functional requirements (NFRs)
• Translate business requirements into scalable, secure AI solution designs
• Collaborate with product, engineering, data science, cloud and security teams to deliver enterprise-ready AI systems
• Design solutions leveraging cloud principles on AWS, Azure or Google Cloud for interoperability, observability and production readiness
• Establish reusable architecture patterns for RAG, model serving, and AI workflow integration
• Ensure alignment with Responsible AI, governance, data handling, and compliance requirements
• Conduct architecture assessments, design reviews, and PoCs for new AI use cases
• Review designs across pods and guide architecture decisions and standards
• Partner with DevSecOps to support release architecture and scalability planning

Skills

Generative AI

LLMs

Cloud architecture

API architecture

Security & resiliency

Stakeholder management

Education

Bachelor’s degree in CS/engineering/math

Master’s degree preferred

Tools

AWS

Azure

GCP

Job description

State Street seeks an AI System Design Architect (AVP) to own end-to-end design for a major GenAI platform, coordinating with product, engineering, data science, cloud and control teams. You will translate business needs into scalable, secure architectures on AWS/Azure/GCP, define reference patterns, and ensure governance and production readiness across the AI stack.

This role emphasizes security, resiliency, observability, and alignment with enterprise architecture standards while collaborating