Data Platform Engineer

SCC; United Kingdom; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

SCC is seeking an experienced Data Platform Engineer to design, build and optimise enterprise data platforms across hybrid cloud landscapes (Azure, AWS, GCP). You will implement data lakes, warehouses and lakehouse architectures, and drive automation via IaC and DevOps practices.

You will collaborate with architects, developers and analysts to deliver scalable, secure data platform capabilities and support data transformation and migration initiatives in a regulated enterprise environment.

Qualifications

• Experience designing and supporting enterprise data platforms in cloud/hybrid environments.
• Strong knowledge of data integration, ETL/ELT concepts.

Responsibilities

• Design, build and maintain enterprise-scale data platforms.
• Develop and manage cloud-based and hybrid data environments across Azure, AWS and/or GCP.
• Implement and support data storage, processing and integration solutions including data lakes, data warehouses and lakehouse architectures.
• Configure, maintain and optimise platform infrastructure for reliability, scalability, security and performance.
• Collaborate with data engineers, architects, developers, analysts and stakeholders to deliver robust platform capabilities.
• Design and automate deployment/configuration/management using IaC and DevOps best practices.
• Support platform services including Databricks, Snowflake, Synapse Analytics, Redshift, BigQuery and related technologies.
• Monitor platform health, performance and availability; identify opportunities for optimisation.
• Ensure compliance with security, governance, regulatory and data management standards.
• Support data transformation programmes and cloud migration initiatives.
• Troubleshoot complex platform issues and resolve incidents to minimise disruption.
• Contribute to roadmaps, architecture reviews and strategic data initiatives.
• Provide technical leadership and best-practice guidance across platform engineering.

Skills

Data platform design

Cloud/hybrid environments

Stakeholder mgmt

Analytical thinking

DevOps practices

CI/CD

Communication

Education

Bachelor's degree in Computer Science / Information Systems

Cloud certification(s)

Tools

Terraform

Bicep

ARM Templates

CloudFormation

Docker

Kubernetes

Databricks

Snowflake

Synapse Analytics

Redshift

BigQuery

Python

PowerShell

Job description

Data Platform Engineer - London / Bracknell / Birmingham / Leeds / Manchester / Livingston - Hybrid - SCC Flex Contract

We are seeking an experienced Data Platform Engineer to support high-profile transformation and technology initiatives across a complex enterprise environment. This is an exciting opportunity for a Data Platform Engineer to join a dynamic client programme, driving the design, implementation and optimisation of modern enterprise data platforms. The successful Data Platform Engineer will play a key role in enabling data-driven decision-making by delivering scalable, secure and resilient data platform capabilities that support analytics, AI, business intelligence and digital transformation objectives across the organisation.

Your responsibilities as the Data Platform Engineer:

• Design, build and maintain enterprise-scale data platforms that support business-critical workloads and data services.
• Develop and manage cloud-based and hybrid data platform environments across Azure, AWS and/or GCP.
• Implement and support data storage, processing and integration solutions including data lakes, data warehouses and lakehouse architectures.
• Configure, maintain and optimise platform infrastructure to ensure reliability, scalability, security and performance.
• Collaborate with data engineers, architects, developers, analysts and business stakeholders to deliver robust platform capabilities.
• Design and automate platform deployment, configuration and management processes using Infrastructure as Code (IaC) and DevOps best practices.
• Support the implementation of modern data platform services including Databricks, Snowflake, Synapse Analytics, Redshift, BigQuery and related technologies.
• Monitor platform health, performance and availability, proactively identifying opportunities for optimisation and improvement.
• Ensure all platform solutions comply with security, governance, regulatory and data management standards.
• Support data transformation programmes and cloud migration initiatives through the adoption of modern platform engineering practices.
• Troubleshoot complex platform issues and provide technical expertise to resolve incidents and minimise service disruption.
• Contribute to technical roadmaps, architecture reviews and strategic data platform initiatives.
• Provide technical leadership and best-practice guidance across platform engineering technologies, processes and methodologies.

As a successful Data Platform Engineer, you will have:

• Proven experience working as a Data Platform Engineer, Platform Engineer or similar role within large-scale enterprise environments.
• Strong experience designing, implementing and supporting enterprise data platforms in cloud and hybrid environments.
• Expertise in cloud technologies including Microsoft Azure, AWS and/or Google Cloud Platform.
• Strong knowledge of data platform services such as Azure Synapse Analytics, Azure Data Lake, Databricks, Snowflake, Amazon Redshift, BigQuery or equivalent technologies.
• Experience building and managing data lakes, lakehouse architectures, data warehouses and analytics platforms.
• Strong understanding of platform engineering principles, cloud infrastructure and distributed systems.
• Experience with Infrastructure as Code technologies such as Terraform, Bicep, ARM Templates or CloudFormation.
• Knowledge of DevOps methodologies, CI/CD pipelines and automation tooling.
• Experience with containerisation and orchestration technologies such as Docker and Kubernetes.
• Good understanding of data integration, ETL/ELT processes and data engineering concepts.
• Familiarity with scripting and automation using Python, PowerShell, Bash or similar languages.
• Strong understanding of security, governance, compliance and operational best practices within enterprise data environments.
• Excellent stakeholder management, communication and collaboration skills.
• Strong analytical, troubleshooting and problem-solving abilities.
• Experience delivering enterprise-scale technology solutions within complex and highly regulated environments.
• Relevant cloud, platform or data certifications are highly desirable.

NOTE: At SCC, we take the privacy and security of your information very seriously. Any information we hold will be handled in accordance with current data protection legislation. Upon submitting your application, SCC will process your information in line with our privacy policy, which can be found on our website under Legal Privacy Notice Flexible Resourcing.