Senior Data Engineer: Build Scalable Cloud Data Platforms

Xpertise Recruitment; City Of London; On-site; GBP 90,000 - 120,000; Full time

Job summary

Xpertise Recruitment in London is seeking a Senior Data Engineer who believes great data engineering means reliable, scalable data products rather than mere data movement. You will shape modern data platforms, tackle complex engineering challenges, and deliver data solutions that unlock tangible business value.

Join a team partnering with architects, analysts, data scientists and engineers to build production-grade platforms supporting analytics, AI and operational decision-making, with cloud

Qualifications

• Strong software engineering fundamentals including Python, Scala or Java, SQL, Git, testing, APIs, and CI/CD.
• Experience building modern cloud-based data platforms within AWS, Azure, or GCP.
• Knowledge of Databricks, Snowflake, Spark, Kafka, dbt, Airflow, or Azure Data Factory.
• Experience designing and delivering end-to-end data engineering solutions.
• Understanding of distributed computing, data partitioning, optimisation, and large-scale data processing.
• Production mindset with monitoring, security, data quality, resilience, and operational support.
• Experience developing lakehouse or modern data warehouse architectures.
• Knowledge of infrastructure-as-code tools such as Terraform.

Responsibilities

• Design, build, and maintain scalable data products and pipelines.
• Own solutions from requirements gathering through to deployment and monitoring.
• Improve platform performance, resilience, security, and cost efficiency.
• Implement data quality, observability, and governance controls.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Contribute to CI/CD, infrastructure-as-code, and automation initiatives.
• Mentor engineers and champion data engineering best practice.

Skills

Python

Scala/Java

SQL

Git

CI/CD

APIs

Testing

Distributed systems

Data modeling

Security

Tools

Databricks

Snowflake

Spark

Kafka

dbt

Airflow

Azure Data Factory

Terraform

Job description

Xpertise Recruitment in London is seeking a Senior Data Engineer who believes great data engineering means reliable, scalable data products rather than mere data movement. You will shape modern data platforms, tackle complex engineering challenges, and deliver data solutions that unlock tangible business value.

Join a team partnering with architects, analysts, data scientists and engineers to build production-grade platforms supporting analytics, AI and operational decision-making, with cloud