Senior Data Engineer: Python, Spark & Databricks (Hybrid)

GCS Recruitment Specialists; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

GCS Recruitment Specialists is seeking a Senior Data Engineer for a hybrid, banking-sector contract role in London. You will build scalable data pipelines using Python, Databricks and Spark, and own critical data platforms end-to-end.

The role demands strong SQL, Databricks expertise and experience delivering enterprise-grade data solutions in cloud environments. You will collaborate with engineers and stakeholders to drive performance and reliability.

Qualifications

• Proven data engineering experience in Python, Databricks and Spark environments.
• Strong SQL development and data integration design.
• Experience building scalable ETL/ELT pipelines at enterprise scale.
• Hands-on experience with Databricks Lakehouse architectures.
• Experience with cloud platforms (Azure, AWS or GCP).
• Familiar with Agile development and CI/CD practices.
• Excellent problem-solving and debugging skills.

Responsibilities

• Design, develop and maintain scalable data pipelines.
• Develop Databricks-based data solutions and lakehouse architectures.
• Optimise data processing workloads for performance and reliability.
• Collaborate with stakeholders to deliver effective data solutions.
• Promote testing, code reviews, and CI/CD adoption.
• Mentor engineers and contribute to best practices.

Skills

Data engineer experience

Python

Databricks

Spark / PySpark

SQL

ETL design

Distributed computing

Cloud platforms

Software best practices

Agile

Troubleshooting

Tools

Databricks

Airflow

Databricks Workflows

Kafka

Docker

Kubernetes

CI/CD

Job description

GCS Recruitment Specialists is seeking a Senior Data Engineer for a hybrid, banking-sector contract role in London. You will build scalable data pipelines using Python, Databricks and Spark, and own critical data platforms end-to-end.

The role demands strong SQL, Databricks expertise and experience delivering enterprise-grade data solutions in cloud environments. You will collaborate with engineers and stakeholders to drive performance and reliability.