Senior ML Architect: Scale-ready AI Systems

SAP SE; Palo Alto (CA); On-site; USD 198,000 - 420,000; Full time

Job summary

SAP SE is seeking an experienced ML Architect to design and optimize large-scale ML systems, including LLMs, for production success in a global environment. You will mentor engineers, set architectural standards, and ensure governance and performance goals are met.

The role emphasizes bridge-building with stakeholders, driving adoption of modern ML techniques, and aligning product objectives with engineering excellence, security, and compliance expectations.

Qualifications

• 10+ years of software engineering experience with a track record of delivering complex systems
• Bachelor's degree in Computer Science, Mathematics, Physics, or related field
• Hands-on experience with AI/ML in production environments, including large language models (LLM), retrieval-augmented generation (RAG), prompt engineering, vector search, agent workflows, and model evaluation techniques
• Expertise in distributed systems design and large-scale enterprise product architecture
• Strong programming skills, proficiency with ML frameworks, and solid understanding of MLOps practices
• Excellent English communication skills and ability to collaborate effectively in global, multicultural teams

Responsibilities

• Design and optimize large-scale ML systems (LLM capabilities and infrastructure) and shape cutting-edge infrastructure
• Mentor engineers and define architectural and operational standards
• Ensure ML solutions meet business, performance, scalability, and governance requirements
• Influence technical direction across products and enable safe experimentation

Skills

ML architecture

Model deployment

MLOps

Distributed systems

English communication

Education

BSc/BA in CS/Math/Physics

Tools

LLMs

RAG

Vector search

Agent workflows

Model evaluation

Job description

SAP SE is seeking an experienced ML Architect to design and optimize large-scale ML systems, including LLMs, for production success in a global environment. You will mentor engineers, set architectural standards, and ensure governance and performance goals are met.

The role emphasizes bridge-building with stakeholders, driving adoption of modern ML techniques, and aligning product objectives with engineering excellence, security, and compliance expectations.