AI Systems Engineer III – Scalable GPU Backend

Walmart Global Tech

Bentonville (AR)

On-site

USD 90,000 - 180,000

Full time

12 days ago

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

401(k) match

Stock purchase plan

Paid maternity and parental leave

PTO

Health plans

Incentive awards

Job summary

Walmart Global Tech is seeking a Software Engineer to design AI-first systems, focusing on agentic AI, high-performance data/compute frameworks, and scalable services. You will integrate LLMs/agents, orchestrate pipelines with Ray, and accelerate data science workloads with RAPIDS while delivering robust APIs and SDKs.

The role blends strong software engineering with practical ML systems exposure and a passion for performance, reliability, and developer experience.

Qualifications

Bachelor's degree in CS/Engineering or equivalent experience.
4+ years building production backend or platform services (AI/ML context preferred).
Proficiency in Python; also Go/Java/C++ for performance services.
Experience with distributed frameworks: Ray, Spark, or Dask.
Experience with RAPIDS and GPU-aware programming.
Service frameworks: FastAPI/Flask; Kubernetes and Docker.
Strong data structures, algorithms, concurrency, networking, and systems design.

Responsibilities

Build agentic AI services and integration with internal systems and APIs.
Design orchestration, memory, tooling, evaluation, and guardrails for workflows.
Collaborate with DS/MLE to productionize models behind stable APIs/SDKs.
Develop GPU-accelerated data pipelines and optimize end-to-end performance.
Create reliable microservices for training/inference and real-time decisioning.
Implement observability, fault tolerance, and auto-scaling.