GenAI Platform Architect AVP — End-to-End AI Systems

State Street; Quincy (MA); On-site; USD 90,000 - 157,500; Full time

Benefits offered by this job

401K with company match

Health insurance

Paid time off

Employee Assistance Program

Job summary

State Street seeks an AI System Design Architect (AVP) to own end-to-end system design for a major GenAI platform. You will translate business requirements into robust architectures, define standards and non-functional requirements, and collaborate with product, engineering, data science, cloud, and security teams to deliver scalable, production-grade AI solutions.

The role emphasizes cloud-native design on AWS/Azure/GCP, reusable patterns for RAG, model serving, and strong governance to ensure

Qualifications

• Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or related field.
• 8–14 years of experience in solution/enterprise architecture or AI/ML architecture.
• Strong hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI integration.
• Experience cloud architecture and design on AWS, Azure, or GCP.
• Understanding of cloud-native services (compute, storage, networking, IAM, security, AI/ML).
• Expertise in API architecture, microservices, distributed systems, event-driven patterns.

Responsibilities

• Own end-to-end architecture and system design for a major GenAI platform domain.
• Define reference architectures, design standards, contracts, and non-functional requirements.
• Translate business requirements into scalable, secure AI solution designs.
• Collaborate with product, engineering, data science, cloud, and security teams.
• Design cloud-aligned solutions on AWS/Azure/GCP for interoperability and scalability.
• Establish reusable architecture patterns for RAG, model serving, and agentic AI workflows.
• Ensure alignment with Responsible AI, governance, data handling, and compliance.
• Conduct architecture reviews and provide guidance on decisions and trade-offs.
• Support production readiness, release architecture, monitoring, and scalability planning.

Skills

GenAI & ML architectures

RAG architectures

Vector databases

AI integration patterns

Cloud architecture

API & microservices

Security & compliance

Observability & performance

Stakeholder management

Cross-functional collaboration

Education

Bachelor’s degree in CS/Engineering

Master’s degree preferred

Tools

AWS

Azure

Google Cloud Platform (GCP)

Job description

State Street seeks an AI System Design Architect (AVP) to own end-to-end system design for a major GenAI platform. You will translate business requirements into robust architectures, define standards and non-functional requirements, and collaborate with product, engineering, data science, cloud, and security teams to deliver scalable, production-grade AI solutions.

The role emphasizes cloud-native design on AWS/Azure/GCP, reusable patterns for RAG, model serving, and strong governance to ensure