Senior ML Architect & AI Strategy Leader

SAP Careers; Palo Alto (CA); On-site; USD 210,000 - 320,000; Full time

Job summary

SAP is seeking a Senior ML Architect to lead design and deployment of large-scale ML systems, including LLM capabilities, at scale. You will mentor engineers, set architectural standards, and ensure production-ready solutions aligned with product goals.

The role requires strong background in distributed systems, MLOps, and driving AI adoption across global teams. Excellent English communication and stakeholder collaboration are essential.

Qualifications

• 10+ years of software engineering experience delivering complex systems
• Bachelor's degree in Computer Science, Mathematics, Physics, or related field
• Hands-on AI/ML in production environments including LLM, RAG, prompt engineering, vector search, agent workflows, and model evaluation techniques
• Distributed systems design and large-scale enterprise product architecture
• Strong programming skills, proficiency with ML frameworks, and solid understanding of MLOps practices
• Excellent English communication and global collaboration ability

Responsibilities

• Lead design and optimization of large-scale ML systems (LLM capabilities and infrastructure)
• Mentor engineers and define architectural and operational standards
• Ensure ML solutions meet business, performance, scalability, and governance requirements
• Influence technical direction across products and enable safe experimentation

Skills

ML architecture

Scalable deployment

ML platform capabilities

LLM

RAG

Prompt engineering

Vector search

Agent workflows

Model evaluation

Education

Bachelors in CS/Math/Physics or related

Tools

ML frameworks

MLOps tooling

Job description

SAP is seeking a Senior ML Architect to lead design and deployment of large-scale ML systems, including LLM capabilities, at scale. You will mentor engineers, set architectural standards, and ensure production-ready solutions aligned with product goals.

The role requires strong background in distributed systems, MLOps, and driving AI adoption across global teams. Excellent English communication and stakeholder collaboration are essential.