Senior AI Systems Engineer – Scalable LLM Infra

Engg; Colorado; On-site; USD 180,000 - 230,000; Full time

Job summary

Workday in Colorado seeks a Senior Software Development Engineer for the AI Model Serving team. You will help shape platform vision, make critical design decisions, and drive outcomes that enable AI workloads to run reliably at scale across production services.

You’ll lead with deep Python and distributed-systems expertise, deploy Kubernetes and GPU infrastructure, manage open-weight LLMs, and write design docs.

Qualifications

• 6+ years of related work experience building and operating large-scale distributed systems.
• Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
• Deep proficiency in Python with production-grade code and systems in Python-based frameworks.

Responsibilities

• Lead the team technically by making critical design decisions that drive performance, reliability, and scalability across the platform.
• Design, implement, and maintain large-scale systems that enable moving ML models to production.
• Write design documents to build consensus for new system components and enhancements to existing components.
• Evaluate and uptake new technologies available within Workday and across the broader industry.
• Troubleshoot, improve, and scale continuous integration software pipelines.
• Develop relationships with software engineers, ML engineers, and data scientists on partner teams.
• Respond to alerts and debug production issues to maintain platform health and reliability.
• Review pull requests and enforce consistency, performance, readability, and security across code bases.
• Develop documentation to share knowledge with other engineers.

Skills

Python

Distributed Systems

Kubernetes

GPU Infrastructure

LLMs

Observability

Communication

Mentorship

Education

Bachelor's degree in CS/Engineering

Tools

vLLM

TGI

LoRA

Job description

Workday in Colorado seeks a Senior Software Development Engineer for the AI Model Serving team. You will help shape platform vision, make critical design decisions, and drive outcomes that enable AI workloads to run reliably at scale across production services.

You’ll lead with deep Python and distributed-systems expertise, deploy Kubernetes and GPU infrastructure, manage open-weight LLMs, and write design docs.