Senior Distributed Systems Engineer (Hybrid)

Workday; Santa Clara (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Workday is hiring for a Senior/Mid-Level Software Engineer to join the Data Platform and Observability team. Hybrid work with up to 50% remote, focusing on building scalable observability services and AI-driven tools for real-time and batch data processing.

You will own tracing, instrumentation, and dashboards, collaborating across platforms and cloud environments, while shaping SLOs/SLIs and production readiness for critical services.

Qualifications

• 8+ years in software eng/design with strong Python/Go/Java background.
• Experience Linux-based environments and distributed systems.
• Strong understanding of time-series databases, log collection, and data integrity.

Responsibilities

• Design and improve observability services: Monitoring, Logging, Alerting, Tracing.
• Own end-to-end distributed tracing, context propagation, and multi-hop diagnostics.
• Build data capture/collection services across Kubernetes, Docker, OpenStack, bare metal.
• Develop core software for real-time and batch data processing.
• Create metrics pipelines, alerting rules, and dashboard tooling.
• Apply AI-driven observability techniques to reduce noise and speed incident response.
• Partner with product teams to define SLOs/SLIs and production readiness.
• Develop production infrastructure and deploy in production.

Skills

Python

Go

Java

Linux

Time-series DBs

Distributed tracing

Public cloud

Docker

Kubernetes

Ansible

Chef

Terraform

Prometheus

CloudWatch

LangChain

LlamaIndex

Semantic Kernel

LLM orchestration

Education

BS in Computer Science

MS degree (plus)

Tools

Docker

Kubernetes

Ansible

Chef

Terraform

AWS CloudWatch

GCP Stackdriver

Prometheus

Job description

Workday is hiring for a Senior/Mid-Level Software Engineer to join the Data Platform and Observability team. Hybrid work with up to 50% remote, focusing on building scalable observability services and AI-driven tools for real-time and batch data processing.

You will own tracing, instrumentation, and dashboards, collaborating across platforms and cloud environments, while shaping SLOs/SLIs and production readiness for critical services.