Data Platform Engineer – AWS Lakehouse & Automation

OCC Computer Personnel; City Of London; Hybrid; GBP 65,000 - 85,000; Full time

Job summary

A tech-driven organization is looking for a Data Platform Engineer in London to enhance their enterprise Data Lakehouse platform. This role involves defining and building infrastructure, ensuring resilience and security in a cloud-based environment. Responsibilities include automation through Infrastructure as Code, managing CI/CD pipelines, and collaborating with engineering teams. The organization offers a hybrid work model, valuing engineering best practices and innovation.

Qualifications

• Experience with AWS data services, including RDS and Redshift.
• Proven background in data lake integration and infrastructure automation.
• Strong understanding of CI/CD practices and tools.

Responsibilities

• Define, build, and evolve the enterprise Data Lakehouse platform.
• Ensure the data platform is resilient, secure, and cost-effective.
• Design and maintain Infrastructure as Code solutions supported by CI/CD pipelines.

Skills

AWS

Apache Spark

Python

Terraform

Ansible

CI/CD

GitLab

Snowflake

Databricks

Tools

AWS Glue

Iceberg

S3

RDS

Redshift

Kafka/MSK

Jenkins

Job description

A tech-driven organization is looking for a Data Platform Engineer in London to enhance their enterprise Data Lakehouse platform. This role involves defining and building infrastructure, ensuring resilience and security in a cloud-based environment. Responsibilities include automation through Infrastructure as Code, managing CI/CD pipelines, and collaborating with engineering teams. The organization offers a hybrid work model, valuing engineering best practices and innovation.