GenAI Platform Architect AVP - Enterprise AI Systems

State Street; Princeton (NJ); On-site; USD 90,000 - 157,500; Full time

Benefits offered by this job

401K with company match

Insurance coverage (medical, dental,视）

Paid time off and volunteer days

Flexible work-life support

Job summary

State Street in Princeton, NJ, seeks an AI System Design Architect (AVP) to own end-to-end design for a major GenAI platform, translating business needs into scalable architectures across the AI stack. You will define reference architectures, governance, and non-functional requirements, partnering with product, engineering, data science, cloud, and security teams.

You will design cloud-based solutions on AWS, Azure, or Google Cloud, establishing reusable patterns for RAG, model serving, and AI

Qualifications

• Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master’s degree preferred.
• 8–14 years of experience in solution architecture, enterprise architecture, platform architecture, or AI/ML architecture.
• Strong hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI application integration.
• Proven experience in cloud architecture and solution design on AWS, Azure, or Google Cloud Platform.

Responsibilities

• Own end-to-end architecture and system design for a major AI platform domain, including model integration, orchestration, APIs, data flows, and downstream system interactions.
• Define and implement reference architectures, design standards, integration contracts, and non-functional requirements (NFRs).
• Translate business and product requirements into scalable, secure, resilient AI solution designs.
• Collaborate with product, engineering, data science, cloud, and security teams to deliver enterprise-ready AI systems.
• Design solutions leveraging cloud architecture principles on AWS, Azure, or Google Cloud, ensuring interoperability and observability.
• Establish reusable architecture patterns for RAG, model serving, prompt workflows, and AI application integration.
• Ensure alignment with Responsible AI, governance, data handling, compliance, testing, and production controls.
• Conduct architecture assessments, technical design reviews, and PoCs for new AI use cases.
• Review designs across pods and guide architecture decisions and standards.

Skills

Generative AI

LLMs

ML systems

RAG architectures

API architecture

microservices

distributed systems

event-driven

security

scalability

observability

performance

Responsible AI

model risk

compliance

operational controls

cloud architecture

AWS

Azure

GCP

Education

Bachelor’s degree in Computer Science, Engineering, or related discipline

Master’s degree preferred

Tools

AWS

Azure

GCP

Job description

State Street in Princeton, NJ, seeks an AI System Design Architect (AVP) to own end-to-end design for a major GenAI platform, translating business needs into scalable architectures across the AI stack. You will define reference architectures, governance, and non-functional requirements, partnering with product, engineering, data science, cloud, and security teams.

You will design cloud-based solutions on AWS, Azure, or Google Cloud, establishing reusable patterns for RAG, model serving, and AI