Senior Machine Learning Engineer

SAP SE; Palo Alto (CA); Hybrid; USD 149,000 - 306,000; Full time

Job summary

SAP in Palo Alto, CA is seeking a Senior Machine Learning Engineer to drive GenAI features across SAP applications. You’ll join a nimble Data Science team to develop cutting-edge GenAI tools and accelerate proof-of-concept work within SAP’s GenAI initiatives.

You will design and implement multi-tenant cloud-backed ML solutions, collaborate with data scientists, and contribute to ML lifecycle—from data to deployment—using back-end expertise and AI model optimization.

Qualifications

• Masters of science degree in Software Engineering.
• Experience in designing, developing, deploying, and testing multi-tenant cloud apps with backend & AI models.
• Experience in developing data-driven microservices, APIs, CI/CD pipelines, Data pipelines, TDD, hands-on with Docker and Kubernetes, familiar with one cloud provider.
• At least 7+ years of professional experience as a developer.
• 3+ years working with SAP BTP and SAP AI Core.
• Strong knowledge in Java, Python and NodeJs.
• At least 2+ years of professional experience optimizing and serving ML models.
• Experience with Python in Linux-based environments, Git, and ML frameworks (PyTorch/TensorFlow)
• Experience in data analysis and visualization and strong knowledge in SQL or Postgres.
• Ability to work in an agile SCRUM environment.
• Strong communication and collaboration skills across cross-cultural teams.

Responsibilities

• Work closely with our lead architect to craft solutions for Data Scientist partners.
• Work closely with SAP data scientists to understand their projects and needs.
• Create high level requirements and designs.
• Follow and help define architectural and coding best practices and participate in design reviews with frontend-, backend-, full-stack, Dev-Ops and AI engineers.
• Support the product team with technical feasibility analysis, solution proposals, and ballpark effort estimations.
• Contribute to all processes of the ML lifecycle: data collection, annotation, modeling, evaluation, deployment, and monitoring

Skills

Java

Python

NodeJs

Docker

Kubernetes

SQL

PyTorch

TensorFlow

GIT

AWS

GCP

Azure

SCRUM

Communication

Education

Masters of science degree in Software Engineering

Tools

SAP BTP

SAP AI Core

ReactJS

SAP UI5

Job description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What you’ll do:

Summary:

At SAP, we amplify the strength of AI technology, fusing it with our robust industry-focused data and profound process knowledge. Our vision is to infuse every SAP application with sophisticated AI capabilities, revolutionizing the way businesses operate. Large Language Models (LLMs) hold immense potential to change the way we work and develop products. They are reshaping the landscape of Machine Learning across various domains. Our goal is to combine the power of LLMs with Knowledge Graphs for business AI problems in SAP applications.

We are a nimble and versatile engineering team created to empower our Data Scientists. This team will be responsible for developing cutting‑edge tools, providing development resources for proof‑of‑concept projects, and collaborating on groundbreaking Gen AI initiatives. Our ultimate objective is to expedite the development and implementation of innovative Gen AI features throughout SAP.

As a Senior Machine Learning Engineer on this team you will be responsible for helping to design and implement a variety of projects around the GenAI space.

The Role:

• Work closely with our lead architect to craft solutions to the many challenges facing our Data Scientist partners.
• Work closely with SAP data scientists to understand their projects and their needs.
• Create high level requirements and designs.
• Follow and help define architectural / coding best practices and participate in software design and code reviews with the development team consisting of frontend-, backend-, full‑stack, Dev‑Ops and AI engineers.
• Support the product team with technical feasibility analysis, solution proposals, and ballpark effort estimations.
• Contribute to all processes of the ML lifecycle: data collection, annotation, modeling, evaluation, deployment, and monitoring

What you bring:

Required:

• Masters of science degree in Software Engineering.
• Experience in designing, developing, deploying, and testing multi‑tenant business applications in the cloud with a focus on backend infrastructure and AI models
• Experience in developing data‑driven microservices, APIs, CI/CD pipelines, Data pipelines, TDD, hands‑on experience with docker containers and Kubernetes, familiar with one of the cloud providers.
• At least 7+ years of professional experience as developer.
• 3+ years working with SAP BTP platform & SAP AI Core.
• Strong knowledge in Java, Python and NodeJs.
• At least 2+ years of professional experience optimizing and serving Machine Learning models.
• Experience with Python in Linux‑based environments, Git, and ML frameworks (PyTorch/TensorFlow)
• Experience in data analysis and visualization and strong knowledge in SQL or Postgres.
• Ability to work in an agile environment using SCRUM methodology.
• Strong communication and collaboration skills, with the ability to work effectively in cross‑cultural teams.

Preferred:

• Experience in data science or data engineering.
• Experience working with Generative AI Models.
• Experience working with SAP GenAI Hub tools and underlying architecture
• Familiarity with Git, Docker, Kubernetes, AWS, GCP, Azure, ReactJS, SAP UI5.

Meet your team:

• The SAP's Business AI organization is dedicated to seamlessly infusing AI into all enterprise applications, enabling customers, partners, and developers to enhance business processes and generate remarkable business value. Join our international AI team where innovation thrives, opportunities for personal development abound, and exceptional colleagues collaborate globally.

Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end‑to‑end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose‑driven and future‑focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP's culture of inclusion, focus on health and well‑being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e‑mail with your request to Recruiting Operations Team: [e-mail].

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability.

Compensation Range Transparency: SAP believes the value of pay transparency contributes towards an honest and supportive culture and is a significant step towards demonstrating SAP’s commitment to pay equity. SAP provides the annualized compensation range inclusive of base salary and variable incentive target for the career level applicable to the posted role. The targeted annual combined range for this position is 148600-306300USD. The actual amount to be offered to the successful candidate will be within that range, dependent upon the key aspects of each case which may include education, skills, experience, scope of the role, location, etc. as determined through the selection process. Any SAP variable incentive includes a targeted dollar amount and any actual payout amount is dependent on company and personal performance. Please reference this link for a summary of SAP benefits and eligibility requirements: SAP North America Benefits.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Employment Type: Regular Full Time

Expected Travel: 0 - 10%

Location: Palo Alto, CA, US, 94304

Work Area: Software-Design and Development

Career Status: Professional

Additional Locations: #LI-Hybrid

Nearest Major Market: San Jose

Nearest Secondary Market: Palo Alto

Job Segment: ERP, Test Engineer, Cloud, Testing, SAP, Technology, Engineering