Senior ML Architect: Scalable AI & MLOps Leader

SAP SE; Palo Alto (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

SAP SE is seeking an experienced ML Architect to design and scale large-scale ML systems, including LLM capabilities and infrastructure. You will mentor engineers, drive architectural standards, and ensure governance and security compliance across products.

You will work closely with stakeholders to translate customer needs into feasible solutions, leveraging RAG, vector search, and advanced MLOps practices. Strong collaboration in a global team is required.

Qualifications

• 10+ years of software engineering experience with a track record of delivering complex systems
• Bachelor's degree in Computer Science, Mathematics, Physics, or related field
• Hands-on experience with AI/ML in production environments, including LLM, RAG, prompt engineering, vector search, agent workflows, and model evaluation techniques
• Expertise in distributed systems design and large-scale enterprise product architecture
• Strong programming skills, proficiency with ML frameworks, and solid understanding of MLOps practices
• Excellent English communication skills and ability to collaborate effectively in global, multicultural teams

Responsibilities

• Architect and optimize large-scale ML systems (LLM capabilities and infra)
• Lead deployment at scale with governance, performance, and security standards
• Mentor engineers and establish engineering standards
• Collaborate with stakeholders to clarify requirements and propose customer-value solutions
• Influence technical direction across products and ensure production readiness

Skills

ML architecture

LLM deployment

RAG & vector search

Prompt engineering

Agent workflows

Model evaluation

English communication

Education

Bachelor's degree in Computer Science, Mathematics, Physics, or related field

Tools

ML frameworks

MLOps tooling

Cloud platforms

Job description

SAP SE is seeking an experienced ML Architect to design and scale large-scale ML systems, including LLM capabilities and infrastructure. You will mentor engineers, drive architectural standards, and ensure governance and security compliance across products.

You will work closely with stakeholders to translate customer needs into feasible solutions, leveraging RAG, vector search, and advanced MLOps practices. Strong collaboration in a global team is required.