Senior AI Systems Engineer – Scalable ML Infra

Walmart; Bellevue (WA); On-site; USD 108,000 - 216,000; Full time

Benefits offered by this job

401(k) match

Stock purchase plan

Maternity/paternity leave

Health plans (medical, vision, dental)

Paid time off

Job summary

Walmart Global Tech is seeking a Software Engineer to design AI-first systems, integrate LLMs/agents, and build high-performance data/compute pipelines at scale. You’ll work across model-driven features, orchestrating Ray-based workflows, and delivering robust APIs and services powering AI applications.

Strong ML systems exposure and performance focus are essential. The role emphasizes production backend development, microservices for training/inference, observability, and CI/CD for AI services,

Qualifications

• Bachelor's or Master's in CS/Engineering or equivalent experience.
• 4+ years building production backend or platform services, preferably AI/ML.
• Strong foundation in Python; proficiency in Go/Java/C++ for performance services; distributed frameworks like Ray/Spark/Dask.

Responsibilities

• Build agentic AI services and integrate with internal APIs.
• Design orchestration, memory, tooling, and guardrails for agentive workflows.
• Collaborate with DS/MLE partners to productionize models behind stable APIs and SDKs.
• Develop GPU-accelerated pipelines and optimize end-to-end performance.
• Use Ray for distributed compute and scalable workflow orchestration.
• Profile and optimize CPU/GPU/memory/I/O bottlenecks; implement caching and vectorization.
• Build reliable microservices for training/inference, vector indexing, and real-time decisions.
• Establish CI/CD for AI services with tests and canaries.
• Integrate with feature stores, vector databases, and model catalogs.
• Ensure security, privacy, and governance across systems.

Skills

Python

Go/Java/C++

Ray

Spark/Dask

RAPIDS

GPU programming

Kubernetes

Docker

FastAPI/Flask

Education

Bachelor's/Master's in CS/Engineering

Tools

cuDF/cuML/cuGraph

FAISS/Milvus/pgvector

ONNX/TensorRT

Job description

Walmart Global Tech is seeking a Software Engineer to design AI-first systems, integrate LLMs/agents, and build high-performance data/compute pipelines at scale. You’ll work across model-driven features, orchestrating Ray-based workflows, and delivering robust APIs and services powering AI applications.

Strong ML systems exposure and performance focus are essential. The role emphasizes production backend development, microservices for training/inference, observability, and CI/CD for AI services,