Data Platform Engineer

OCC Computer Personnel; City Of London; Hybrid; GBP 65,000 - 85,000; Full time

Job summary

A tech-driven organization is looking for a Data Platform Engineer in London to enhance their enterprise Data Lakehouse platform. This role involves defining and building infrastructure, ensuring resilience and security in a cloud-based environment. Responsibilities include automation through Infrastructure as Code, managing CI/CD pipelines, and collaborating with engineering teams. The organization offers a hybrid work model, valuing engineering best practices and innovation.

Qualifications

• Experience with AWS data services, including RDS and Redshift.
• Proven background in data lake integration and infrastructure automation.
• Strong understanding of CI/CD practices and tools.

Responsibilities

• Define, build, and evolve the enterprise Data Lakehouse platform.
• Ensure the data platform is resilient, secure, and cost-effective.
• Design and maintain Infrastructure as Code solutions supported by CI/CD pipelines.

Skills

AWS

Apache Spark

Python

Terraform

Ansible

CI/CD

GitLab

Snowflake

Databricks

Tools

AWS Glue

Iceberg

S3

RDS

Redshift

Kafka/MSK

Jenkins

Job description

Data Platform Engineer London

(AWS, Apache Spark, AWS Glue, Iceberg, S3, RDS, Redshift, Kafka/MSK, Python, Terraform, Ansible, CI/CD, Jenkins, GitLab, Snowflake, Databricks)

Working with an established FinTech client in London who is looking for a Data Platform Engineer to play a key role in defining, building, and evolving their enterprise Data Lakehouse platform during an exciting period of growth. You'll work closely with Platform Engineering and Application Engineering teams, taking ownership of the infrastructure, patterns, standards, and tooling used to build and operate data products across the business.

The role focuses on ensuring the data platform is resilient, secure, reliable, and cost-effective within an AWS environment. You'll be responsible for how the platform is operated, maintained, monitored, and extended, with a strong emphasis on observability, fault prevention, and early fault detection across AWS data services.

Automation is central to the way this team works. You'll design and maintain Infrastructure as Code and Configuration as Code solutions, supported by CI/CD pipelines, to ensure consistent, repeatable deployments and strong governance. You'll also enhance data lake integration testing, security measures, monitoring, SLAs, and operational metrics.

Working for a tech‑driven organisation in a collaborative environment, for an organisation that values engineering best practices! This client is offering this role on hybrid basis, looking to be in the office a few times per month.

For more information, please get in touch.