Senior Software Engineer, Distributed Systems & AI

Workday; Santa Clara (CA); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Workday is hiring for a Senior or Mid-Level Software Engineer on the Data Platform and Observability team. You will design and scale critical observability services, including monitoring, logging, alerting, and tracing, across multi-cloud environments.

In a hybrid setup, you’ll collaborate with global teams and contribute to AI-powered workflows that reduce incidents and improve performance. We handle billions of messages daily and billions of time-series, building a trustworthy platform with

Qualifications

• 7 years of coding in Python, Go, or Java
• Experience with Linux
• 8 years of software engineering/design experience
• BS in Computer Science or a related field, or equivalent experience
• MS Degree a plus
• Ability to design, maintain, and optimize Time-Series DBs, document stores, and log collection/management systems
• Hands-on experience with LLM orchestration frameworks and agentic AI build patterns

Responsibilities

• Design, build, and improve critical observability services: Monitoring, Logging, Alerting, and Tracing
• Own distributed tracing end to end instrumenting services
• Build data capture and collection services using modern tech across environments
• Design and develop core software modules for real-time and batch data processing
• Build metrics ingestion pipelines, alert definitions, and automation for dashboard lifecycle management
• Instrument AI-powered workflows for performance, cost, and quality
• Define SLOs/SLIs and production-readiness criteria for new services
• Build infrastructure components and deploy them in production
• Work across all aspects of observability with focus on data quality and availability
• Evaluate and implement new open-source and cloud-native tools

Skills

Python

Go

Java

Linux

Distributed systems

Communication

Education

BS in Computer Science or related field

MS Degree a plus

Tools

LangChain

LlamaIndex

Semantic Kernel

Docker

Kubernetes

Prometheus

Terraform

Ansible

Chef

Job description

Workday is hiring for a Senior or Mid-Level Software Engineer on the Data Platform and Observability team. You will design and scale critical observability services, including monitoring, logging, alerting, and tracing, across multi-cloud environments.

In a hybrid setup, you’ll collaborate with global teams and contribute to AI-powered workflows that reduce incidents and improve performance. We handle billions of messages daily and billions of time-series, building a trustworthy platform with