Staff Data Platform Engineer — Stream Processing

Coreweave; Sunnyvale (CA); On-site; USD 207,000 - 275,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) employer match

Job summary

CoreWeave is seeking a Staff Engineer specializing in Data Platforms and Stream Processing to advance our multi-regional datastore strategy and data flow models. You will work with a 6–8 person team on a range of challenging data infrastructure projects in a fast-paced, collaborative environment.

You’ll mentor engineers, drive architectural decisions, and contribute to Kubernetes-based data solutions while ensuring scalability, security, and reliability across our platforms.

Qualifications

• 15+ years of experience in a software or infrastructure engineering industry.
• Understand data consistency and concurrency models; define data models and data management guidelines.
• Familiar with distributed NewSQL datastores such as CockroachDB, TiDB, YDB, Yugabyte and stream processing tools such as NATS or Kafka.
• Experience designing and operating these systems at scale.
• Familiar with Kubernetes for event-driven and/or stateful orchestration.
• Interested in contributing to a Kubernetes operator to manage data systems.
• Proficient with Linux, shell scripting, and Linux storage/networking stacks.
• Able to transform problems into elastic solutions and decompose tasks for teammates.
• Production-level proficiency in Go or Python; open source contributions.

Responsibilities

• Drive technical decisions to accelerate delivery, mentor engineers, and grow team capability.
• Champion event-driven architecture adoption and build consensus across the organization.
• Identify and develop applications for the organization's data and create data-driven solutions.
• Design and implement the platform to deliver data to teams with managed solutions.
• Develop a stream processing architecture for scalability and reliability.
• Improve data platform performance, security, reliability, and scalability; participate in on-call rotation.
• Establish data access and storage guidelines for stakeholder teams.
• Ensure compliance with data protection standards.

Skills

Go/Python

Kubernetes

Streaming systems

Data platforms

Linux shell

Tools

CockroachDB

TiDB

Yugabyte

NATS

Kafka

Job description

CoreWeave is seeking a Staff Engineer specializing in Data Platforms and Stream Processing to advance our multi-regional datastore strategy and data flow models. You will work with a 6–8 person team on a range of challenging data infrastructure projects in a fast-paced, collaborative environment.

You’ll mentor engineers, drive architectural decisions, and contribute to Kubernetes-based data solutions while ensuring scalability, security, and reliability across our platforms.