Senior Streaming Engineer, Real-Time Observability Platform

Crusoe; San Francisco (CA); On-site; USD 209,000 - 253,000; Full time

Benefits offered by this job

Industry competitive pay

Restricted Stock Units

Health insurance package options (HDHP

PPO, vision, and dental

Employer contributions to HSA accounts

Paid Parental Leave

Paid life insurance, short‑term and长‑终

Teladoc

401(k) with a 100% match up to 4%

Generous paid time off and holiday

Cell phone reimbursement

Tuition reimbursement

Subscription to the Calm app

MetLife Legal

Company paid commuter benefit; $300/月

Job summary

Crusoe is seeking a Senior Streaming Software Engineer to join the Observability team in our Cloud Infrastructure group. You will design, build, and operate high‑throughput streaming systems that power real‑time telemetry across our GPU cloud and global data centers.

You’ll work with Kafka, Kinesis, Pub/Sub and Flink to ingest logs, metrics, traces, and events, ensure reliability with instrumentation and dashboards, and collaborate with SREs across on‑call rotations and incident reviews.

Qualifications

• Experience building and operating distributed systems, especially streaming or real‑time data platforms.
• Hands‑on experience with Kafka or similar distributed streaming technologies.
• Proficiency in backend languages such as Java, Scala, Go, or Python.
• Experience operating services in cloud or large‑scale infrastructure environments.
• Solid understanding of observability fundamentals including metrics, logging, tracing, and alerting.
• Comfort debugging production issues across distributed systems.
• Ability to own features end‑to‑end, from design through production operations.
• Strong collaboration skills and a pragmatic engineering mindset.

Responsibilities

• Designing, building, and maintaining streaming services and pipelines that ingest and process observability data including logs, metrics, traces, and operational events.
• Implementing real‑time data processing systems using technologies such as Kafka, Kinesis, Pub/Sub, Flink, or similar streaming platforms.
• Scaling streaming infrastructure to support high‑throughput telemetry ingestion, high‑cardinality workloads, and bursty infrastructure traffic patterns.
• Ensuring streaming systems are reliable and observable, with strong instrumentation, dashboards, and alerting.
• Collaborating with SREs and platform teams to integrate streaming data into internal observability tools and operational workflows.
• Participating in on‑call rotations, incident response, and post‑incident reviews.
• Improving system reliability and developer experience through automation, CI/CD, and infrastructure‑as‑code practices.
• Contributing to technical design discussions and reviews for new streaming capabilities.

Skills

Distributed systems

Kafka

Java/Scala/Go/Python

Cloud infrastructure

Observability fundamentals

Production debugging

End-to-end ownership

Collaboration

Tools

Kafka

Kinesis

Pub/Sub

Flink

Kubernetes

Containerized infrastructure

Schema management

Job description

Crusoe is seeking a Senior Streaming Software Engineer to join the Observability team in our Cloud Infrastructure group. You will design, build, and operate high‑throughput streaming systems that power real‑time telemetry across our GPU cloud and global data centers.

You’ll work with Kafka, Kinesis, Pub/Sub and Flink to ingest logs, metrics, traces, and events, ensure reliability with instrumentation and dashboards, and collaborate with SREs across on‑call rotations and incident reviews.