Software Engineer III- AI Systems

Walmart; Bellevue (WA); On-site; USD 108,000 - 216,000; Full time

Benefits offered by this job

401(k) match

Stock purchase plan

Maternity/paternity leave

Health plans (medical, vision, dental)

Paid time off

Job summary

Walmart Global Tech is seeking a Software Engineer to design AI-first systems, integrate LLMs/agents, and build high-performance data/compute pipelines at scale. You’ll work across model-driven features, orchestrating Ray-based workflows, and delivering robust APIs and services powering AI applications.

Strong ML systems exposure and performance focus are essential. The role emphasizes production backend development, microservices for training/inference, observability, and CI/CD for AI services,

Qualifications

• Bachelor's or Master's in CS/Engineering or equivalent experience.
• 4+ years building production backend or platform services, preferably AI/ML.
• Strong foundation in Python; proficiency in Go/Java/C++ for performance services; distributed frameworks like Ray/Spark/Dask.

Responsibilities

• Build agentic AI services and integrate with internal APIs.
• Design orchestration, memory, tooling, and guardrails for agentive workflows.
• Collaborate with DS/MLE partners to productionize models behind stable APIs and SDKs.
• Develop GPU-accelerated pipelines and optimize end-to-end performance.
• Use Ray for distributed compute and scalable workflow orchestration.
• Profile and optimize CPU/GPU/memory/I/O bottlenecks; implement caching and vectorization.
• Build reliable microservices for training/inference, vector indexing, and real-time decisions.
• Establish CI/CD for AI services with tests and canaries.
• Integrate with feature stores, vector databases, and model catalogs.
• Ensure security, privacy, and governance across systems.

Skills

Python

Go/Java/C++

Ray

Spark/Dask

RAPIDS

GPU programming

Kubernetes

Docker

FastAPI/Flask

Education

Bachelor's/Master's in CS/Engineering

Tools

cuDF/cuML/cuGraph

FAISS/Milvus/pgvector

ONNX/TensorRT

Job description

Bellevue, WA: $108,000 - $216,000/yr

Bentonville, AR: $90,000 - $180,000/yr

Position Summary

We're seeking a Software Engineer to design and build AI-first systems with a focus on agentic AI, high performance data/compute frameworks, and scalable, production-grade services. You'll work across model-driven features and platform layers-integrating LLMs/agents, orchestrating pipelines with Ray, accelerating data science workloads with RAPIDS, and delivering robust APIs and services that power high-impact AI applications at scale. The ideal candidate blends strong software engineering fundamentals with practical ML systems exposure and a passion for performance, reliability, and developer experience.

Key Responsibilities

• Build agentic AI services (planning, tool use, retrieval, feedback loops) and integrate them with internal systems and APIs.
• Implement orchestration, memory, tooling, evaluation, and guardrails for agentic workflows.
• Collaborate with DS/MLE partners to productionize models (LLMs, GNNs, embedding services) behind stable APIs and SDKs.
• Develop GPU-accelerated pipelines using RAPIDS (cuDF/cuML/cuGraph) and optimize end-to-end performance.
• Use Ray (or similar) for distributed compute, batch/stream processing, and scalable workflow orchestration.
• Profile and optimize bottlenecks across CPU/GPU, memory, and I/O layers; implement caching, vectorization, and async patterns.
• Design and maintain reliable microservices for training/inference, vector indexing, and real-time decisioning.
• Implement observability (tracing/metrics/logging), fault tolerance, auto-scaling, and cost-aware execution.
• Create internal SDKs/CLIs to streamline developer workflows, testing, and reproducibility.
• Establish CI/CD for AI services (unit/integration/e2e tests, canaries, blue/green, rollback).
• Integrate with feature stores, vector databases, artifact registries, and model catalogs.
• Enforce security, privacy, and compliance (data minimization, PII handling, governance, auditability).
• Partner with product, platform, and DS/MLE teams to align requirements, SLAs, and success metrics.
• Document systems thoroughly; contribute to design reviews and engineering best practices.
• Mentor peers on AI systems patterns, distributed compute, and performance engineering.

Minimum Qualifications

• Bachelor's/Master's in CS, Engineering, or equivalent industry experience.
• 4+ years building production backend or platform services (preferably in AI/ML contexts).
• Proficiency in:Languages: Python (primary), plus one of Go/Java/C++ for performance services. Distributed frameworks: Ray, Spark, or Dask. Accelerated compute: RAPIDS (cuDF/cuML/cuGraph) and GPU-aware programming concepts (streams, memory). Service frameworks: FastAPI/Flask (Python), K8s (Kubernetes) and containerization (Docker). Strong foundations in data structures/algorithms, concurrency, networking, and systems design.

Preferred Qualifications

• Production experience with agent frameworks (e.g., LangGraph-style planners, tool-use patterns, retrieval and memory components).
• Experience with vector databases (e.g., FAISS, Milvus, pgvector, Pinecone) and feature stores.
• Familiarity with LLM and embedding services, prompt/tooling patterns, and evaluation harnesses.
• Hands-on with Kubernetes, autoscaling (HPA/KEDA), and GPU scheduling/operators.
• Performance profiling: PyTorch profiler, Nsight, line-profiler, Ray dashboard.
• Experience with vLLM, Triton Inference Server, ONNX Runtime, or TensorRT for high-throughput inference.

Soft Skills & Leadership

Pragmatic problem solver with a bias for measurable outcomes (latency, throughput, reliability). Excellent communicator able to translate between research goals and production constraints. Drives clarity in ambiguous problem spaces; mentors others and uplifts engineering standards.

About Walmart Global Tech

Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail. Walmart's culture is a competitive advantage, and it's fostered by being together. Working together in person allows us to collaborate, align quickly and innovate with greater speed. We use our campuses to create purposeful connection rooted in deepening understanding and investing in the development of our associates. Our hubs: Walmart is a global company with offices across the United States and around the world. Our global headquarters is in Bentonville, Arkansas, with primary hubs in the San Francisco Bay area and New York/New Jersey.

Benefits

• Beyond our great compensation package, you can receive incentive awards for your performance.
• Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.
• Health benefits include medical, vision and dental coverage.
• Financial benefits include 401(k), stock purchase and company-paid life insurance.
• Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
• Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
• You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes.
• The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.
• Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities.
• Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates.
• Tuition, books, and fees are completely paid for by Walmart.
• Eligibility requirements apply to some benefits and may depend on your job classification and length of employment.

Equal Opportunity Employer

Walmart, Inc. is an Equal Opportunity Employer - By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas, and opinions - while being inclusive of all people.

The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process. At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet.

Primary Location

2501 Se J St, Ste A, Bentonville, AR 72716-3724, United States of America

Walmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

Walmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

Benefits you'll enjoy Discount Card Get 10% off Walmart associates are eligible for a 10% discount card on most regular-priced items and fresh produce in-store and on select items at Walmart.com. Eligible after 90 days of employment. Live Better U100% covered Earn a degree or in-demand skills certificates with no debt- Walmart covers 100% of tuition and books. Live Better U offers 60+ programs for Associates to pursue their dreams. Walmart Academy Grow your skills Ready to grow your career? Walmart Academy offers job-specific retail training and leadership courses to help Associates reach their career goals. Financial perks Enjoy 401(k) matching and stock purchase plans. Paid time off Take a break as needed for vacation, sick leave, holidays, parental leave, and more Comprehensive health benefits Medical, dental, vision, and wellness programs for you and your family Wellbeing programs Access mental health resources and assistance programs for life's challenges Career growth opportunities Training, leadership programs, and clear paths to advance. Learn more Life at Walmart Imagine a workplace surrounded by innovation. At Walmart's new Home Office in Bentonville, Arkansas, we're redefining what it means to work at a global leader. Set on 350 acres of thoughtfully revitalized land, our new campus seamlessly integrates the charm of Northwest Arkansas with cutting edge design and technology. From biking trails and outdoor courtyards to flexible, tech-enabled workspaces, every detail reflects our commitment to sustainability, connection, and culture. With amenities like on-site childcare at our Little Squiggles Children's Enrichment Center, the Walton Family Whole Health & Fitness Center, and a vibrant food hall featuring local and international favorites, we're creating a space where work-life balance isn't just a goal-it's a reality. Beyond the campus, Bentonville offers a dynamic lifestyle with world-class dining, art at the Crystal Bridges Museum, and countless outdoor activities. Whether you're exploring High South cuisine, enjoying live performances at our new amphitheater, or cycling the Razorback Greenway, you'll experience the perfect blend of small-town charm and big-city amenities. Join us at Walmart and grow your career alongside a community that feels like home. This isn't just a workplace-it's a destination for leaders eager to make a difference.