Senior ML Platform Engineer - Low-Latency GenAI

Workday, Inc.; Pleasanton (CA); Hybrid; USD 192,000 - 288,000; Full time

Benefits offered by this job

Flexible work model

Stock grants

Job summary

Workday, Inc. is seeking a Sr Software Development Engineer (ML/AI) to lead the design and scaling of advanced ML pipelines and AI-driven features on the Admin Central platform.

You will work across data ingestion, feature stores, and low-latency inference services to support hundreds of customer accounts. You will bridge production ML engineering with modern ML/LLM architectures, building features, retraining pipelines, and observability into agent execution loops using LangSmith and LangChain.

Qualifications

• 8+ years in ML research, development, and implementation of advanced models/techniques, including 4+ years building, deploying, and operating production ML systems at scale.
• 5+ years in deep learning, NLP, and GenAI/LLM orchestration using frameworks like PyTorch, TensorFlow, Scikit-learn, LangChain, and LlamaIndex, plus proficiency in Java, Go, Scala, or C++ for high-performance backend systems.

Responsibilities

• Architect, deploy, and maintain end-to-end Machine Learning pipelines—from distributed data ingestion and feature engineering to model training, evaluation, and production deployment.
• Design algorithms and LLM-driven recommendation features (e.g., IDD insights, next-best-action models) that optimize agentic workflows and tool usage.
• Optimize real-time model inference and scoring microservices to ensure sub-second response times across high-concurrency multi-tenant environments.
• Integrate telemetry and tracing (OpenTelemetry, LangChain, LangSmith) into ML pipelines to track model performance, prompt/response drift, and execution efficiency.
• Collaborate with core backend engineers to leverage big data platforms (ClickHouse, Apache Iceberg, Spark) for high-dimensional feature retrieval and analytics.
• Partner closely with Product Managers, Data Engineering, SRE, and Legal/Compliance to translate complex business and governance requirements into scalable ML solutions.

Skills

ML pipelines

LangChain

LangSmith

Python

Kubernetes

Distributed systems

Education

Bachelor's degree in CS/Data Science

Tools

Kafka

Spark

ClickHouse

S3

Kubeflow

MLflow

Job description

Workday, Inc. is seeking a Sr Software Development Engineer (ML/AI) to lead the design and scaling of advanced ML pipelines and AI-driven features on the Admin Central platform.

You will work across data ingestion, feature stores, and low-latency inference services to support hundreds of customer accounts. You will bridge production ML engineering with modern ML/LLM architectures, building features, retraining pipelines, and observability into agent execution loops using LangSmith and LangChain.