Staff, Software Engineer

Walmart; California (MO); On-site; USD 90,000 - 150,000; Full time

Job summary

Join a forward-thinking company that is revolutionizing the shopping experience through advanced technology and personalized solutions. As part of the Personalization team, you will be at the forefront of developing real-time inference systems that leverage machine learning and deep learning. You'll collaborate with talented professionals to create scalable solutions that enhance customer journeys across various platforms. This role offers a unique opportunity to lead architectural discussions, mentor team members, and implement best practices in an agile environment. If you are passionate about technology and eager to make a significant impact, this position is perfect for you.

Qualifications

• 4 years of software engineering experience or 6 years of relevant experience.
• Knowledge of accessibility standards and inclusive design practices is valued.

Responsibilities

• Design and develop a Real-Time Inference System for ML models.
• Implement best practices in MLOps for model lifecycle management.

Skills

Real-Time Inference Systems

Machine Learning

Deep Learning

NLP

Java

NoSQL

RDBMS

Kafka

Kubernetes

Docker

CI/CD

Cloud Platforms

Education

Bachelor's degree in Computer Science

Master’s degree in relevant fields

Tools

MLflow

KF Serving

Grafana

Prometheus

Job description

Position Summary...

The Personalization team at Walmart is dedicated to understanding our customers better and providing a frictionless, faster shopping experience across all platforms, including online and in-store grocery pickup. We aim to deliver tailored journeys based on individual preferences, operating at the intersection of extensive product assortment, millions of customers, and thousands of stores. Our team comprises data scientists, engineers, and product visionaries focused on creating innovative, technology-driven solutions that enable personalized e-commerce experiences using advanced machine learning, deep learning, reinforcement learning, NLP, and knowledge representation.

What you'll do...

• Design and develop a Real-Time Inference System for deploying deep learning and traditional ML models with low latency, scalable on Kubernetes, supporting frameworks like TensorRT, TensorFlow, PyTorch, ONNX, and Custom.
• Develop capabilities for inference of Generative AI models, including RAG, model fine-tuning, and semantic caching.
• Implement best practices in MLOps for model lifecycle management, ensuring reproducibility, versioning, deployment, monitoring, and updates.
• Collaborate with cross-functional teams to align ML platform capabilities with product and business needs.
• Lead architectural discussions to ensure a modular, scalable, fault-tolerant platform.
• Mentor team members and promote best engineering practices in an agile environment.

You’ll sweep us off our feet if:

• You have experience building real-time inference systems for ML models, especially for LLMs.
• You are familiar with model lifecycle management tools like MLflow and KF Serving.
• You possess strong skills in Java, object-oriented and functional programming, design patterns, NoSQL, RDBMS, Kafka, containerization (Kubernetes, Docker), microservices (Spring), CI/CD (Jenkins, Maven), and cloud platforms (Azure, GCP).
• You have experience monitoring production systems with tools like Grafana and Prometheus.
• You are eager to learn modern technologies and communicate effectively.
• You have worked on ranking, advertising, recommendation systems, or e-commerce.

Minimum Qualifications...

Option 1: Bachelor's degree in computer science, engineering, or related field plus 4 years of software engineering experience.

Option 2: 6 years of relevant experience.

Preferred Qualifications...

Master’s degree in relevant fields with 2 years of experience, or equivalent experience. Knowledge of accessibility standards (WCAG 2.2 AA), assistive technologies, and inclusive design practices is highly valued.

Primary Location...

680 West California Avenue, Sunnyvale, CA 94086-4834, United States of America