Senior ML Architect: Scalable LLM Systems & AI Strategy

SmartRecruiters, Inc.; Palo Alto (CA); On-site; USD 198,000 - 420,000; Full time

Job summary

SAP is seeking an experienced Senior ML Architect in Palo Alto to design and deploy large-scale ML systems, focusing on LLMs, RAG, and MLOps. You will mentor engineers, shape architectural standards, and ensure compliance with performance and security standards.

You will act as a trusted advisor, bridging customer needs with SAP product capabilities, and contributing to SAP's AI strategy and governance framework.

Qualifications

• 10+ years of software engineering experience with a track record of delivering complex systems
• Bachelor's degree in Computer Science, Mathematics, Physics, or related field
• Hands-on experience with AI/ML in production environments, including large language models (LLM), retrieval-augmented generation (RAG), prompt engineering, vector search, agent workflows, and model evaluation techniques
• Expertise in distributed systems design and large-scale enterprise product architecture
• Strong programming skills, proficiency with ML frameworks, and solid understanding of MLOps practices
• Excellent English communication skills and ability to collaborate effectively in global, multicultural teams

Responsibilities

• Architect ML solutions and deploy at scale.
• Bridge customer requirements to product capabilities and propose solutions.
• Mentor engineers and define architectural standards.
• Ensure production-ready ML systems aligned with product objectives.

Skills

AI/ML in production

Distributed systems design

Large language models

MLOps practices

English communication

Education

Bachelor's degree in Computer Science, Mathematics, Physics, or related field

Tools

ML frameworks

Job description

SAP is seeking an experienced Senior ML Architect in Palo Alto to design and deploy large-scale ML systems, focusing on LLMs, RAG, and MLOps. You will mentor engineers, shape architectural standards, and ensure compliance with performance and security standards.

You will act as a trusted advisor, bridging customer needs with SAP product capabilities, and contributing to SAP's AI strategy and governance framework.