Data Platform Engineer — Hybrid, Cloud & Lakehouse

SCC; United Kingdom; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

SCC is seeking an experienced Data Platform Engineer to design, build and optimise enterprise data platforms across hybrid cloud landscapes (Azure, AWS, GCP). You will implement data lakes, warehouses and lakehouse architectures, and drive automation via IaC and DevOps practices.

You will collaborate with architects, developers and analysts to deliver scalable, secure data platform capabilities and support data transformation and migration initiatives in a regulated enterprise environment.

Qualifications

• Experience designing and supporting enterprise data platforms in cloud/hybrid environments.
• Strong knowledge of data integration, ETL/ELT concepts.

Responsibilities

• Design, build and maintain enterprise-scale data platforms.
• Develop and manage cloud-based and hybrid data environments across Azure, AWS and/or GCP.
• Implement and support data storage, processing and integration solutions including data lakes, data warehouses and lakehouse architectures.
• Configure, maintain and optimise platform infrastructure for reliability, scalability, security and performance.
• Collaborate with data engineers, architects, developers, analysts and stakeholders to deliver robust platform capabilities.
• Design and automate deployment/configuration/management using IaC and DevOps best practices.
• Support platform services including Databricks, Snowflake, Synapse Analytics, Redshift, BigQuery and related technologies.
• Monitor platform health, performance and availability; identify opportunities for optimisation.
• Ensure compliance with security, governance, regulatory and data management standards.
• Support data transformation programmes and cloud migration initiatives.
• Troubleshoot complex platform issues and resolve incidents to minimise disruption.
• Contribute to roadmaps, architecture reviews and strategic data initiatives.
• Provide technical leadership and best-practice guidance across platform engineering.

Skills

Data platform design

Cloud/hybrid environments

Stakeholder mgmt

Analytical thinking

DevOps practices

CI/CD

Communication

Education

Bachelor's degree in Computer Science / Information Systems

Cloud certification(s)

Tools

Terraform

Bicep

ARM Templates

CloudFormation

Docker

Kubernetes

Databricks

Snowflake

Synapse Analytics

Redshift

BigQuery

Python

PowerShell

Job description

SCC is seeking an experienced Data Platform Engineer to design, build and optimise enterprise data platforms across hybrid cloud landscapes (Azure, AWS, GCP). You will implement data lakes, warehouses and lakehouse architectures, and drive automation via IaC and DevOps practices.

You will collaborate with architects, developers and analysts to deliver scalable, secure data platform capabilities and support data transformation and migration initiatives in a regulated enterprise environment.