Senior AI/ML Engineer: Lead Multi-Agent Systems in Production

SAP SE; Newport Beach (CA); Hybrid; USD 131,000 - 271,600; Full time

Job summary

SAP is building specialized foundation models and AI agents to accelerate data transformation for SAP customers worldwide. The Foundation Model team develops domain-specific models and the agentic layer that integrates them into SAP products.

You will lead multi-agent system architecture, production deployment, tooling, observability, and mentorship across global teams in Europe, India, and the US, focusing on production-grade ML systems.

Qualifications

• Education: BS, MS, or PhD in Computer Science, ML, or a related field.
• 6+ years building and shipping ML systems, with 3+ years hands-on with LLMs and agents in production.

Responsibilities

• Architect and lead multi-agent systems: design, orchestration patterns, failure modes, memory, planning, and human-in-the-loop.
• Own the path from prototype to production: containerization, guardrails, cost and latency optimization, scalable serving.
• Define the team's evaluation strategy: offline/online harnesses, trajectory quality, tool-call accuracy, regression testing, CI/CD eval gates.
• Lead instrumentation and observability: tracing, span capture, automated scoring, closing the trace → eval → fix loop.
• Drive tool integration architecture via MCP across multiple product teams.
• Mentor junior and mid-level engineers through code and architecture reviews; set engineering standards.

Skills

Multi-agent systems

LLMs production

PyTorch

LangChain

CI/CD

Observability

Mentoring

Code reviews

Tool integration

Education

BS/MS/PhD in CS/ML

Tools

LangGraph/LangChain

Langfuse

CrewAI

AutoGen/AG2

Job description

SAP is building specialized foundation models and AI agents to accelerate data transformation for SAP customers worldwide. The Foundation Model team develops domain-specific models and the agentic layer that integrates them into SAP products.

You will lead multi-agent system architecture, production deployment, tooling, observability, and mentorship across global teams in Europe, India, and the US, focusing on production-grade ML systems.