Staff Data Platform Engineer — Real-Time Pipelines & Infra

The Consensus; United Kingdom; Remote; GBP 110,000 - 170,000; Full time

Job summary

Kpler's Data Platform tribe builds tooling and datasets that underpin our products, delivering scalable real-time and batch data pipelines for geospatial data. You will drive architectural decisions and champion reliability, observability, and end-to-end ownership across cloud-based infrastructure.

The Staff Engineer role involves mentoring engineers, aligning priorities, and collaborating with product and domain stakeholders to deliver high-impact data initiatives.

Qualifications

• 10+ years of experience in data or software engineering roles, with DevOps exposure.
• Strong backend/data/distributed systems foundations; significant Java experience.
• Proven experience with streaming tech: Kafka or Flink.
• Ability to translate business priorities into technical/delivery outcomes with stakeholders.
• Deep understanding of distributed systems and architectural trade-offs.
• Significant use of AI agents in professional work.
• Cloud environment experience (AWS, GCP, Azure).
• Excellent written and spoken English.

Responsibilities

• Design, develop and maintain real-time and batch data pipelines.
• Improve reliability and observability; own operational excellence of data pipelines.
• Own cloud-based infrastructure; build it and run it.
• Manage data products with diverse stakeholders.
• Provide strategic and technical leadership; mentor engineers.
• Understand complex domain with multiple cross-team dependencies.
• Own features end-to-end.

Skills

10+ years experience

Java

Kafka

Flink

Stakeholder collaboration

Distributed systems

AI agents

Cloud (AWS/GCP/Azure)

English

Spark

Terraform

Pulumi

Python

Scala

Job description

Kpler's Data Platform tribe builds tooling and datasets that underpin our products, delivering scalable real-time and batch data pipelines for geospatial data. You will drive architectural decisions and champion reliability, observability, and end-to-end ownership across cloud-based infrastructure.

The Staff Engineer role involves mentoring engineers, aligning priorities, and collaborating with product and domain stakeholders to deliver high-impact data initiatives.