Backend Engineer - Real-Time Data Pipelines & Microservices

Kpler; Scotland; On-site; GBP 80,000 - 110,000; Full time

Job summary

Kpler in the United Kingdom (Scotland) is seeking an Engineer II in the Maritime & Logistics division to design, build, and operate high-throughput data processing and API systems. You will own real-time streaming applications and backend services delivering maritime intelligence to global consumers via streaming tech.

You will work with Java, Scala, Python; Kafka, Flink, Airflow; Kubernetes, Docker and GitOps.

Qualifications

• 3+ years of professional software engineering delivering backend microservices and data pipelines.
• Strong proficiency in Java, Scala, and Python.
• Experience building event-driven apps or data pipelines in AWS.
• Experience operating containerized services on Kubernetes with Docker and GitOps.
• Solid SQL, relational DB design, and distributed systems fundamentals.

Responsibilities

• Design, build, and maintain high-performance backend microservices and APIs using Java, Scala, and Python.
• Design, develop, and operate real-time data pipelines and stream-processing applications using Java, Scala, Kafka Streams, and Apache Flink, as well as batch-processing workflows using Python and Apache Airflow.
• Drive end-to-end technical ownership of backend services from initial design and testing through deployment, continuous monitoring, and production operations.
• Optimize system health, throughput, and consumer lag across streaming infrastructure to maximize data freshness and platform uptime.
• Investigate production incidents, perform root-cause analysis, and implement long-term structural improvements.
• Reduce technical debt by elevating maintainability, observability, automated test coverage, and CI/CD practices.
• Partner cross-functionally with product managers, platform engineers, and peer teams to turn complex maritime domain needs into robust software.

Skills

Java

Scala

Python

AWS

Kubernetes

Docker

GitOps

SQL

Distributed systems

Tools

GeoServer

PostGIS

WKT

S2

H3

Job description

Kpler in the United Kingdom (Scotland) is seeking an Engineer II in the Maritime & Logistics division to design, build, and operate high-throughput data processing and API systems. You will own real-time streaming applications and backend services delivering maritime intelligence to global consumers via streaming tech.

You will work with Java, Scala, Python; Kafka, Flink, Airflow; Kubernetes, Docker and GitOps.