Enterprise AI Platform Architect - Scale, Security & RAG

Apollo Solutions; New York (NY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Apollo Solutions is seeking an AI Platform Architect in New York, NY, hybrid work with three days in the office. The role leads the design and evolution of enterprise-scale AI platforms and capabilities, defining architecture standards, scalable patterns, governance, and best practices for secure, production-ready AI solutions.

The candidate will drive end-to-end solution design across multi-product and multi-domain environments in a large financial services context, working with engineering and

Qualifications

• 5+ years of experience in Enterprise Architecture, Platform Architecture, Software Engineering, or Distributed Systems Design.
• Experience designing platforms that support multiple products, teams, and business domains.
• Deep understanding of AI architecture and platform design.
• Hands-on experience with model gateways, RAG, vector databases, orchestration frameworks, tool calling, AI guardrails, and evaluation strategies.

Responsibilities

• Define and maintain the enterprise reference architecture for AI solutions, including model access and runtime controls.
• Lead end-to-end solution design and delivery for complex AI platform capabilities and services.
• Partner with engineering, security, architecture, and business stakeholders to translate business needs into scalable technical solutions.
• Establish architectural standards for identity management, access controls, data governance, observability, resiliency, and human oversight.
• Define best practices for RAG, vector search, tool calling, agent orchestration, guardrails, and evaluation frameworks.
• Design highly available, fault tolerant AI platforms capable of enterprise-scale operations.
• Develop capacity planning, workload distribution, performance optimization, and scalability strategies.

Skills

Enterprise architecture

Distributed systems

AI architecture

Stakeholder management

Communication

Tools

Vector databases

Job description

Apollo Solutions is seeking an AI Platform Architect in New York, NY, hybrid work with three days in the office. The role leads the design and evolution of enterprise-scale AI platforms and capabilities, defining architecture standards, scalable patterns, governance, and best practices for secure, production-ready AI solutions.

The candidate will drive end-to-end solution design across multi-product and multi-domain environments in a large financial services context, working with engineering and