Senior AI Platform Engineer – Scale ML & Open-Weight LLMs

Workday; Boulder (CO); On-site; USD 150,000 - 200,000; Full time

Job summary

Workday in Boulder, CO is seeking a Senior Software Development Engineer for the AI Model Serving team. You will design, build, and scale systems that host and serve production ML models, ranging from traditional models to large language models powering Workday’s agents.

You will lead architecture decisions, mentor engineers, and collaborate with ML engineers and data scientists to ensure reliability, performance, and cost efficiency in a high-throughput environment.

Qualifications

• 6+ years of experience building and operating large-scale distributed systems.
• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent).
• Excellent written and verbal communication skills.

Responsibilities

• Lead the AI Model Serving team and shape platform vision.
• Design, implement, and maintain large-scale distributed systems for production ML models.
• Write design documents and drive consensus for new components.
• Review PRs and enforce performance, security, and readability.
• Collaborate with engineers, ML engineers, data scientists, and partner teams.
• Respond to alerts and troubleshoot production issues.

Skills

Python

Distributed systems

Kubernetes

GPU infra

Observability

Mentorship

Communication

Education

BS in CS/Engineering or related field

Tools

vLLM

TGI

LoRA

Job description

Workday in Boulder, CO is seeking a Senior Software Development Engineer for the AI Model Serving team. You will design, build, and scale systems that host and serve production ML models, ranging from traditional models to large language models powering Workday’s agents.

You will lead architecture decisions, mentor engineers, and collaborate with ML engineers and data scientists to ensure reliability, performance, and cost efficiency in a high-throughput environment.