Staff Software Engineer - GenAI Platform & Semantic Routing

Walmart Global Tech

Bentonville (AR)

On-site

USD 110,000 - 220,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Performance bonuses

Stock purchase plan

Health benefits

Job summary

Walmart Global Tech is seeking a Staff Software Engineer to strengthen our GenAI experience platform. You will design and implement semantic routing for GenAI-powered services, build evaluation pipelines, and collaborate with data scientists to advance routing algorithms.

The role emphasizes Python-based microservices, FastAPI, and enterprise-grade reliability. You will contribute to agent-to-agent communication, stay current with GenAI best practices, and participate in on-call rotations to

Qualifications

Proven production-quality Python code in a production setting.
Experience building Python-based web services (FastAPI preferred).
Strong version control with Git in collaborative environments.
Experience with Linux and containerization (Docker).
4+ years delivering software products.

Responsibilities

Design and develop platform features for semantic routing in GenAI-powered services.
Build evaluation pipelines with metrics, dashboards, and tests to assess routing accuracy and performance.
Collaborate with researchers to improve semantic routing algorithms and integrate GenAI advancements.
Develop agent-to-agent communication protocols for orchestration of GenAI services.
Create platform features using microservices (FastAPI) and event-driven architecture (Kafka, SSE, WebSocket).
Uphold engineering standards and automate where possible; support production systems via on-call rotations.