Data Engineer: Java, Kafka & Kubernetes - London Hybrid

Free-Work; City of Westminster; Hybrid; GBP 96,000 - 144,000; Full time

Job summary

Free-Work in London is seeking an experienced Data Engineer with strong Java skills to design, build and operate scalable data pipelines for a major technology program. You will work across data ingestion, processing and integration, collaborating with software engineers, DevOps and architects in a hybrid London-based team.

The role requires hands-on Java development, Kafka streaming knowledge, Kubernetes deployment and Python scripting for data processing, with a focus on production-grade

Qualifications

• Strong commercial experience with Java and data engineering.
• Experience with Kafka-based messaging, streaming or event-driven solutions.
• Kubernetes experience deploying or managing containerised apps.
• Python scripting for data processing or automation.
• Understanding of software and data engineering principles.
• Experience with distributed systems and data integration.
• Experience delivering reliable, scalable production solutions.
• Strong troubleshooting and collaboration in Agile teams.
• Effective communication with technical and non-technical stakeholders.

Responsibilities

• Design, develop and maintain scalable data engineering solutions and services.
• Develop robust applications and data-processing components using Java.
• Build and support event-driven and streaming solutions using Apache Kafka.
• Develop and maintain Python-based data processing, automation and integration solutions.
• Deploy and support applications and services within Kubernetes environments.
• Work with large and complex datasets across distributed systems.
• Develop reliable and maintainable data pipelines and integration services.
• Support the integration of data across applications, platforms and services.
• Troubleshoot technical issues across data pipelines, applications and infrastructure.
• Work closely with software engineers, architects, DevOps teams and other technical stakeholders.
• Contribute to technical design discussions and engineering best practices.
• Ensure solutions are scalable, secure, resilient and suitable for production environments.
• Support testing, deployment, monitoring and continuous improvement of engineering solutions.
• Produce and maintain appropriate technical documentation.

Skills

Java

Kafka

Kubernetes

Python

Distributed systems

Data pipelines

Troubleshooting

Agile

Stakeholder comms

Tools

Docker

CI/CD

REST APIs

SQL

NoSQL

Job description

Free-Work in London is seeking an experienced Data Engineer with strong Java skills to design, build and operate scalable data pipelines for a major technology program. You will work across data ingestion, processing and integration, collaborating with software engineers, DevOps and architects in a hybrid London-based team.

The role requires hands-on Java development, Kafka streaming knowledge, Kubernetes deployment and Python scripting for data processing, with a focus on production-grade