Remote Real-Time Streaming Platform Engineer

Bayside Solutions; United States; Remote; USD 76,000 - 90,000; Full time

Job summary

Bayside Solutions, Inc. is seeking an experienced Streaming Data Platform Engineer to design and build large-scale, cloud-native data platform capabilities with a focus on real-time streaming.

You will create reusable services, SDKs, and frameworks to enable ML practitioners to process, manage, and access high-volume data reliably. You will work on distributed streaming systems, platform services, and self-service tooling, collaborating with platform teams and engineers to deliver scalable,

Qualifications

• Strong hands-on real-time streaming experience with Flink or Spark in production.
• Deep understanding of distributed data processing, state management, and recovery.
• Proficiency in Python or Java, API/service design, and automated tests.

Responsibilities

• Design, build, and operate distributed streaming systems with Flink and/or Spark Structured Streaming.
• Develop production-grade platform services, APIs, and SDKs using Python/Java (Spring Boot).
• Contribute to control-plane and data-plane architecture, including orchestration and lifecycle management.
• Enable scalable data management for ML practitioners: datasets, indexing, and training-data workflows.
• Engineer observability, fault tolerance, checkpointing, and performance optimization for distributed systems.
• Collaborate with platform teams, application engineers, and ML practitioners to deliver self-service capabilities.

Skills

Streaming with Flink

Spark Streaming

Python/Java

API design

CI/CD

Distributed systems

Tools

Databricks

Kafka

Kubernetes

Spring Boot

Job description

Bayside Solutions, Inc. is seeking an experienced Streaming Data Platform Engineer to design and build large-scale, cloud-native data platform capabilities with a focus on real-time streaming.

You will create reusable services, SDKs, and frameworks to enable ML practitioners to process, manage, and access high-volume data reliably. You will work on distributed streaming systems, platform services, and self-service tooling, collaborating with platform teams and engineers to deliver scalable,