GenAI Platform Engineer (Python) – Semantic Routing

Walmart Inc.; United States; On-site; USD 110,000 - 220,000; Full time

Benefits offered by this job

Health benefits

401(k) match

Stock purchase plan

Paid time off

Job summary

Walmart, Inc. is hiring a Staff Software Engineer to strengthen our GenAI experience platform. You will design semantic routing, build evaluation pipelines, and collaborate with data scientists to advance GenAI capabilities across Walmart’s massive associate and customer audience.

You’ll work with FastAPI microservices, Kafka-based event flows, and modern Python tooling, contributing to scalable, reliable platform solutions while participating in on-call rotations and code reviews.

Qualifications

• Bachelor's degree in Computer Science or related field required.
• 4+ years of industry experience in software engineering.
• Experience in Python-based web services production environments.
• Strong knowledge of Git, Linux, and containerization.

Responsibilities

• Design and develop platform features enabling semantic routing for GenAI-powered services.
• Build and maintain evaluation pipelines with metrics, dashboards, and tests for routing accuracy and performance.
• Collaborate with researchers and data scientists to improve routing algorithms and integrate GenAI advancements.
• Develop agent-to-agent communication protocols for orchestration between GenAI agents and services.
• Use microservices (FastAPI) and event-driven architecture (Kafka, SSE, WebSocket) in Python.
• Uphold engineering excellence and automate processes; participate in on-call production support.
• Stay current with GenAI and multi-agent system best practices and share knowledge.

Skills

Python

GenAI

Semantic Routing

API Design

Distributed Systems

On-call/Production Support

Code Review

Education

Bachelor's degree in Computer Science or related field

Tools

FastAPI

Docker

Git

Linux

Kafka

WebSocket

SSE

Job description

Walmart, Inc. is hiring a Staff Software Engineer to strengthen our GenAI experience platform. You will design semantic routing, build evaluation pipelines, and collaborate with data scientists to advance GenAI capabilities across Walmart’s massive associate and customer audience.

You’ll work with FastAPI microservices, Kafka-based event flows, and modern Python tooling, contributing to scalable, reliable platform solutions while participating in on-call rotations and code reviews.