Senior Platform Engineer: Real-Time Streaming & Kafka Cloud

StreamNative, Inc.; Northern (KY); Hybrid; USD 140,000 - 200,000; Full time

Job summary

StreamNative, Inc. seeks a Senior Software Engineer to build the Kafka service on StreamNative Cloud, a cloud-native streaming platform with Kafka compatibility and modern storage technologies.

You will tackle distributed systems challenges, including streaming infrastructure, storage scalability, reliability, and performance optimizations, designing and implementing critical platform components. You will join the Platform Engineering team to advance Kafka compatibility with cloud-native storage

Qualifications

• 5+ years building large-scale distributed systems or cloud services.
• Strong understanding of Kafka or Pulsar and distributed messaging systems.
• Experience with Kafka internals: protocol, broker architecture, KRaft, tiered storage, log storage, compaction.
• Experience with cloud-native streaming or storage systems.
• Strong programming skills in Java or Scala.

Responsibilities

• Design, implement, and maintain core components of the streaming platform, including Kafka-compatible APIs and storage systems.
• Troubleshoot and optimize distributed systems for reliability and performance.
• Debug and resolve production issues in large-scale environments.
• Collaborate with customers and field teams to deliver effective technical solutions.
• Contribute to open-source projects and improve developer experience.
• On-call: one week per month, rotating, supporting customer tickets.

Skills

Distributed systems

Kafka/Pulsar knowledge

Cloud-native platforms

Java/Scala

Production systems

Debugging & performance

Independent ownership

Cross-functional collaboration

Tools

Apache Kafka

Apache Pulsar

Kubernetes

Cloud storage (S3/GCS/Azure)

Job description

StreamNative, Inc. seeks a Senior Software Engineer to build the Kafka service on StreamNative Cloud, a cloud-native streaming platform with Kafka compatibility and modern storage technologies.

You will tackle distributed systems challenges, including streaming infrastructure, storage scalability, reliability, and performance optimizations, designing and implementing critical platform components. You will join the Platform Engineering team to advance Kafka compatibility with cloud-native storage