Observability Platform Engineer - Distributed Systems

Workday, Inc.; Pleasanton (CA); Hybrid; USD 148,000 - 222,000; Full time

Benefits offered by this job

Flexible work arrangement

Job summary

Workday, Inc. is seeking a Software Development Engineer to build and scale core features of a distributed tracing platform, working with ClickHouse, Grafana Tempo, and a modern big-data pipeline on AWS. You will deliver high-quality, high-performance code capable of handling massive data loads.

You will join a team focused on observability AI, ensuring reliable data ingestion and scalable APIs, while collaborating with senior engineers to advance distributed systems expertise.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5+ years of software development experience.
• 3+ years designing, building, and operating complex distributed systems with high availability and fault tolerance.

Responsibilities

• Develop the Platform: build and scale features for the distributed tracing platform on ClickHouse/Tempo with robust ingestion and fast query execution.
• Maintain Big-Data Pipelines: support high-throughput data pipelines using Kafka, Spark/Flink, and Iceberg-on-S3.
• Tune and Optimize: write optimized code and profile to resolve latency/throughput issues in production.
• Ensure Reliability: implement robust error handling, retries, and failover for tracing services.
• Secure the Data: enforce multi-tenant data access controls.
• Operational Support: monitor, log, and alert; participate in on-call rotation.
• Support Observability AI: enable reliable data ingestion for AI-driven anomaly detection.

Skills

Distributed systems

Java

Python

Go

API development

CI/CD

Git

Education

Bachelor's degree in CS/Engineering

Master's degree preferred

Tools

Kafka

Spark

Flink

ClickHouse

Iceberg

Tempo

Grafana

OpenTelemetry

Job description

Workday, Inc. is seeking a Software Development Engineer to build and scale core features of a distributed tracing platform, working with ClickHouse, Grafana Tempo, and a modern big-data pipeline on AWS. You will deliver high-quality, high-performance code capable of handling massive data loads.

You will join a team focused on observability AI, ensuring reliable data ingestion and scalable APIs, while collaborating with senior engineers to advance distributed systems expertise.