Senior Streaming Engineer — Real-Time Data Platform

OfferGenie; San Francisco (CA); On-site; USD 170,000 - 205,000; Full time

Benefits offered by this job

Health insurance

401(k) with 100% match up to 4%

Paid Parental Leave

Teladoc

Commuter benefit

Job summary

Crusoe in San Francisco is seeking a Senior Streaming Software Engineer to join the Observability team within Cloud Infrastructure. You will design, build, and operate high-throughput streaming systems that process telemetry data across our GPU cloud and data centers.

You will implement real-time data processing with Kafka, Kinesis, Pub/Sub, or Flink, scale pipelines to handle bursty traffic, and ensure observability with dashboards and alerts.

Qualifications

• Strong experience building distributed systems, especially streaming or real-time data platforms.
• Hands-on experience with Kafka or similar distributed streaming technologies.
• Proficiency in backend languages such as Java, Scala, Go, or Python.
• Experience operating services in cloud or large-scale infrastructure environments.

Responsibilities

• Designing, building, and maintaining streaming services and pipelines that ingest and process observability data including logs, metrics, traces, and operational events.
• Implementing real-time data processing systems using technologies such as Kafka, Kinesis, Pub/Sub, Flink, or similar streaming platforms.
• Scaling streaming infrastructure to support high-throughput telemetry ingestion, high-cardinality workloads, and bursty infrastructure traffic patterns.
• Ensuring streaming systems are reliable and observable, with strong instrumentation, dashboards, and alerting.
• Collaborating with SREs and platform teams to integrate streaming data into internal observability tools and operational workflows.
• Participating in on-call rotations, incident response, and post-incident reviews.

Skills

Distributed systems

Observability

Collaboration

Tools

Kafka

Kinesis

Pub/Sub

Flink

Kubernetes

Job description

Crusoe in San Francisco is seeking a Senior Streaming Software Engineer to join the Observability team within Cloud Infrastructure. You will design, build, and operate high-throughput streaming systems that process telemetry data across our GPU cloud and data centers.

You will implement real-time data processing with Kafka, Kinesis, Pub/Sub, or Flink, scale pipelines to handle bursty traffic, and ensure observability with dashboards and alerts.