Senior Enterprise AI Architect — NYC Hybrid

SAP SE; United States; Hybrid; USD 198,000 - 420,000; Full time

Job summary

SAP SE in New York City is seeking a Principal Forward Deployed Architect to provide technical leadership for SAP’s strategic AI engagements. You will define enterprise AI architectures, lead multidisciplinary delivery teams, and partner with executive stakeholders to shape AI transformation programs.

This senior role requires deep technical expertise and the ability to establish reusable engineering patterns across multiple engagements. Hybrid work from NYC Hudson Yards.

Qualifications

• 10+ years of software engineering and enterprise architecture experience with significant customer-facing delivery.
• Expertise in Python and modern enterprise application architecture.
• Deep experience with LLMs, agentic AI, RAG, Knowledge Graphs, vector databases, MCP, tool calling, evaluation frameworks, and AI observability.
• Extensive experience with SAP BTP, SAP AI Core, Joule, SAP integration technologies, and enterprise landscapes.
• Strong background in Kubernetes, Docker, CI/CD, DevSecOps, cloud platforms (AWS, Azure, GCP), and distributed systems.
• Proven ability to architect large-scale enterprise solutions integrating SAP and non-SAP systems.
• Experience leading cross-functional engineering teams and mentoring senior technical talent.
• Exceptional communication and executive stakeholder management skills.
• Strong strategic thinking with the ability to balance business outcomes, technical excellence, and delivery execution.

Responsibilities

• Own the end-to-end architecture for complex enterprise AI programs from discovery through production.
• Lead solution architecture spanning AI agents, RAG, Knowledge Graphs, MCP, multi-agent systems, enterprise integrations, and cloud-native platforms.
• Serve as the primary technical advisor for customer executives, enterprise architects, and program leadership.
• Architect scalable AI platforms using SAP AI Core, SAP BTP, Joule, Kubernetes, hyperscalers, and enterprise integration services.
• Define reference architectures, reusable frameworks, golden paths, engineering standards, and governance models.
• Lead technical discovery workshops, architecture reviews, and executive solution presentations.
• Guide engineering teams across multiple customer engagements while mentoring senior engineers and architects.
• Drive security, observability, performance, compliance, and operational excellence for enterprise AI solutions.
• Influence SAP product teams by providing architectural feedback from customer implementations.
• Identify innovation opportunities and establish new technical capabilities for the Forward Deployed Engineering organization.

Skills

Python

Enterprise Architecture

LLMs

RAG

Knowledge Graphs

Vector Databases

Tool Calling

Executive Stakeholders

Communication

Education

Bachelor's or Master's in CS/AI/Engineering

Tools

SAP BTP

SAP AI Core

Joule

Kubernetes

Docker

Job description

SAP SE in New York City is seeking a Principal Forward Deployed Architect to provide technical leadership for SAP’s strategic AI engagements. You will define enterprise AI architectures, lead multidisciplinary delivery teams, and partner with executive stakeholders to shape AI transformation programs.

This senior role requires deep technical expertise and the ability to establish reusable engineering patterns across multiple engagements. Hybrid work from NYC Hudson Yards.