Hybrid Data Engineer: Cloud Data Platforms & Pipelines

SCC; United Kingdom; Hybrid; GBP 62,000 - 90,000; Full time

Job summary

SCC is looking for an experienced Data Engineer to design, build and optimise scalable data pipelines across hybrid cloud environments in London, Bracknell, Birmingham, Leeds, Manchester or Livingston.

You will work with Azure/AWS/GCP, Databricks, Snowflake and modern data platforms to support analytics, BI and data governance, while ensuring security and scalability in enterprise settings.

Qualifications

• Proven experience building scalable data pipelines in large enterprise environments.
• Experience with cloud data platforms (Azure, AWS, GCP).
• Strong SQL with large volumes of structured and unstructured data.
• Experience with ETL/ELT, data modelling and data architecture principles.
• Familiarity with CI/CD and DevOps practices.

Responsibilities

• Design, build and maintain scalable data pipelines.
• Develop and optimise ETL/ELT processes.
• Build and manage data lakes and data warehouses to support reporting.
• Collaborate with architects, analysts, data scientists and stakeholders to deliver data solutions.
• Design and maintain cloud-based and hybrid data environments, ensuring performance and security.
• Automate data workflows and deployment processes using DevOps practices where applicable.
• Monitor, troubleshoot and optimise data pipelines and platform performance.
• Provide technical leadership and best-practice guidance across data technologies.

Skills

Data pipelines

ETL/ELT

Cloud platforms (Azure/AWS/GCP)

SQL

Python/Scala/Spark

CI/CD / DevOps practices

Tools

Azure Data Factory

Databricks

Snowflake

BigQuery

Synapse Analytics

Job description

SCC is looking for an experienced Data Engineer to design, build and optimise scalable data pipelines across hybrid cloud environments in London, Bracknell, Birmingham, Leeds, Manchester or Livingston.

You will work with Azure/AWS/GCP, Databricks, Snowflake and modern data platforms to support analytics, BI and data governance, while ensuring security and scalability in enterprise settings.