ML Architect: Scalable LLM Systems (Hybrid)

SAP SE; Atlanta (GA); Hybrid; USD 176,000 - 300,000; Full time

Job summary

SAP Labs, LLC in Atlanta, GA seeks a Machine Learning Expert to design and deliver intelligent, distributed systems powering large-scale AI and LLM capabilities. The role requires building production systems in Go, Java, and Python, designing backend services, databases, APIs and LLM infrastructure.

You will mentor engineers and work with cross-functional teams to translate business goals into scalable solutions.

Qualifications

• Bachelor’s degree or foreign equivalent in Technology, Engineering, or a related field and seven (7) years of progressive post-baccalaureate experience in the job offered or related occupation.
• Alternatively, a Master’s degree or foreign equivalent in Technology, Engineering, or a related field of study and five (5) years of experience in the job offered or related occupation.

Responsibilities

• Architect, design, and implement production systems in Go, Java, and Python.
• Build and optimize backend services, databases, APIs, and LLM infrastructure.
• Mentor and guide engineers from junior to senior levels, fostering technical excellence.
• Partner with cross-functional teams to translate business goals into scalable, high-impact solutions.

Skills

Python

GoLang

Java

Software architecture

Cloud-native development

DevOps

Langgraph

Langchain

LLMs

Vector stores

Education

Bachelor’s degree in Tech/Engineering

Master’s degree in Tech/Engineering

Tools

Kafka

Postgres

Hana

gRPC

Job description

SAP Labs, LLC in Atlanta, GA seeks a Machine Learning Expert to design and deliver intelligent, distributed systems powering large-scale AI and LLM capabilities. The role requires building production systems in Go, Java, and Python, designing backend services, databases, APIs and LLM infrastructure.

You will mentor engineers and work with cross-functional teams to translate business goals into scalable solutions.