Data Platform Engineer

Thrive IT Systems; Milton Keynes; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

Thrive IT Systems is seeking a Senior Data Platform Engineer for a hybrid role in Milton Keynes, UK. You will design, deploy and support scalable data platform infrastructure using Kafka, MSK and Kinesis, with Kubernetes, Terraform and IaC practices.

Ideal candidates have hands-on experience with real-time streaming, cloud services and production-scale environments, and will collaborate with DevOps, Data Engineering and Cloud teams to ensure reliability and security.

Qualifications

• Hands-on experience with Apache Kafka.

Responsibilities

• Design, build and maintain scalable data platform infrastructure across cloud environments.
• CoT_job_summary_short 미
• job_summary_short

Skills

Apache Kafka

Amazon MSK

Amazon Kinesis

Terraform / IaC

AWS infrastructure

Real-time streaming

Monitoring & troubleshooting

Production-scale environments

Docker

Prometheus

Grafana

Kubernetes

Helm

Python/Java scripting

Tools

Docker

Prometheus

Grafana

Kubernetes

Helm

Job description

We have one open position of Senior Data Platform Engineer with one of our client based in Milton Keynes, UK. This is a permanent/fulltime position. Below is the full job description for your reference. Please share your application once you are interested

Role: Data Platform Engineer with Banking Domain

Location: Milton Keynes, UK - Hybrid

Work Mode: 12 Months Fix Term Employment & Permanent

Role Overview

We are looking for an experienced Data Platform Engineer with strong expertise in infrastructure, cloud platforms, containerization and real-time data streaming. The ideal candidate should have hands-on experience building, deploying and supporting scalable data platforms using Kafka, Kubernetes, Terraform, Amazon MSK and Amazon Kinesis.

Key Responsibilities

• Design, build and maintain scalable data platform infrastructure across cloud environments.
• Manage and support Apache Kafka / Amazon MSK clusters, including configuration, monitoring, scaling and performance optimization.
• Work extensively with Amazon Kinesis and real-time data streaming platforms.
• Deploy and manage data platform components using Kubernetes.
• Develop and maintain infrastructure using Terraform / Infrastructure as Code (IaC).
• Manage platform reliability, availability, scalability and performance.
• Implement monitoring, alerting, logging and troubleshooting for streaming and infrastructure components.
• Work with DevOps, Data Engineering and Cloud teams to build reliable data-platform solutions.
• Troubleshoot issues related to Kafka brokers, topics, partitions, replication, consumer groups and streaming pipelines.
• Implement security, access control and best practices across cloud and data-platform infrastructure.
• Automate platform provisioning, deployment and operational processes.

Mandatory Skills

• Hands-on experience with Apache Kafka.
• Strong experience with Amazon MSK (Managed Streaming for Apache Kafka).
• Good experience with Amazon Kinesis / Kinesis Data Streams.
• Strong Terraform / Infrastructure as Code experience.
• Good understanding of AWS infrastructure and cloud services.
• Experience with real-time data streaming and distributed systems.
• Strong knowledge of monitoring, troubleshooting and performance optimisation.
• Experience working in production-scale environments.

Good to Have

• AWS certifications.
• Experience with Docker and CI/CD.
• Experience with Prometheus, Grafana, CloudWatch or similar monitoring tools.
• Experience with Helm and Kubernetes operators.
• Experience with Python, Java or Shell scripting.
• Knowledge of networking, security, IAM and Linux administration.
• Experience with data lake/data platform architecture.

Key Focus