Senior AI Systems Architect for GenAI Platform

State Street; Austin (TX); On-site; USD 90,000 - 157,500; Full time

Benefits offered by this job

401K with company match

Paid time off & family care

Flexible work-life support

Job summary

State Street is seeking an AI System Design Architect (AVP) to own end-to-end system design for a major GenAI platform, ensuring secure, scalable, and compliant AI solutions across the enterprise.

The role requires translating business requirements into robust architectures, defining patterns, and collaborating with product, engineering, data science, cloud, and security teams to deliver production-grade AI systems.

Qualifications

• Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master’s degree preferred.
• 8–14 years of experience in solution/enterprise architecture or AI/ML architecture.
• Strong hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI integration.

Responsibilities

• Own end-to-end architecture and system design for a major AI platform, including model integration, orchestration, APIs, data flows, and downstream system interactions.
• Define and implement reference architectures, design standards, integration contracts, and non-functional requirements (NFRs) for the platform area.
• Translate business and product requirements into scalable, secure, resilient AI solution designs.
• Partner with stakeholders to deliver enterprise-ready AI systems across product, engineering, data science, cloud, and security teams.
• Design solutions leveraging cloud principles on AWS, Azure, or Google Cloud for interoperability and observability.
• Establish reusable architecture patterns for RAG, model serving, and AI application integration.
• Ensure alignment with Responsible AI, governance, data handling, compliance, testing, and production controls.
• Conduct architecture assessments and technical design reviews for new AI use cases and platform capabilities.
• Review designs across pods and guide architecture decisions and standards adherence.
• Collaborate with DevSecOps for production readiness, release architecture, monitoring, and scalability.

Skills

Generative AI

LLMs

ML architectures

Cloud platforms

APIs & microservices

Security & resiliency

Governance & compliance

System integration

Observability & performance

Stakeholder communication

Education

Bachelor’s degree in CS/Engineering/related

Master’s degree preferred

Tools

AWS

Azure

GCP

API architecture

Job description

State Street is seeking an AI System Design Architect (AVP) to own end-to-end system design for a major GenAI platform, ensuring secure, scalable, and compliant AI solutions across the enterprise.

The role requires translating business requirements into robust architectures, defining patterns, and collaborating with product, engineering, data science, cloud, and security teams to deliver production-grade AI systems.