Senior AI Platform Engineer — Scale & Reliability

Workday, Inc.; Boulder (CO); On-site; USD 148,000 - 264,000; Full time

Job summary

Workday, Inc. in Boulder, CO is seeking a Senior Software Development Engineer for the AI Model Serving team. You will help shape the platform, drive design decisions, and enable production-grade ML model serving at scale.

You will lead cross-functional collaborations with software, ML engineering, and data science partners, aiming for low latency, high reliability, and cost-effective operations in a rapidly evolving AI stack.

Qualifications

• 6+ years of related work experience in software development, with a focus on building and operating large-scale distributed systems.
• Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
• Deep experience designing, building, and scaling production-grade distributed systems.
• Proficiency in Python and production-grade code for systems in Python-based frameworks.
• Hands-on experience deploying and scaling workloads on Kubernetes with GPU resource management.
• Familiarity with LLMs and traditional ML models in production.
• Ability to design observability strategies for system health, performance, and cost.
• Excellent written and verbal communication; ability to write design documents and build consensus.
• Mentorship experience and fostering an inclusive engineering culture.

Responsibilities

• Lead the team technically by making critical design decisions that drive performance, reliability, and scalability across the platform.
• Design, implement, and maintain large-scale systems to move ML models to production.
• Write design documents to build consensus for new system components and enhancements to existing components.
• Evaluate and uptake new technologies within Workday and across the industry.
• Troubleshoot, improve, and scale CI pipelines.
• Develop relationships with software and ML engineers and data scientists on partner teams.
• Respond to alerts and debug production issues to maintain platform health and reliability.
• Review PRs and enforce code quality, performance, and security across code bases.
• Develop documentation to share knowledge with other engineers.

Skills

Python

Distributed Systems

Kubernetes

GPU Infrastructure

LLMs / ML models

Observability

Communication

Mentorship

Education

Bachelor's degree in Computer Science or related field

Tools

Ray Serve

Open-Weight LLMs tooling

CI/CD pipelines

Job description

Workday, Inc. in Boulder, CO is seeking a Senior Software Development Engineer for the AI Model Serving team. You will help shape the platform, drive design decisions, and enable production-grade ML model serving at scale.

You will lead cross-functional collaborations with software, ML engineering, and data science partners, aiming for low latency, high reliability, and cost-effective operations in a rapidly evolving AI stack.