Senior Data Engineer - Python, Spark & Databricks (Hybrid)

GCS; City Of London; Hybrid; GBP 148,000 - 166,000; Full time

Job summary

GCS is seeking a Senior Data Engineer for a hybrid, contract role in the banking sector. The role focuses on hands-on engineering using Python, Databricks, Spark/PySpark and SQL, delivering scalable data platforms and analytics capabilities in a modern cloud environment.

You will design, develop and optimise pipelines, contribute to data platform stability and work with architects, engineers and stakeholders to drive efficient data solutions.

Qualifications

• Strong commercial experience as a Data Engineer or Senior Data Engineer.
• Expert-level Python development skills.
• Extensive hands-on experience with Databricks in enterprise environments.
• Strong Apache Spark and PySpark expertise.
• Advanced SQL development and optimisation skills.
• Experience working with modern cloud platforms including Azure, AWS or GCP.

Responsibilities

• Design, develop and maintain scalable data pipelines using Python, Databricks and PySpark.
• Build and optimise ETL/ELT solutions processing large-scale datasets.
• Develop high-quality, reusable code and engineering frameworks.
• Deliver robust, performant and maintainable data solutions.
• Troubleshoot and resolve complex production and performance issues.
• Support the ongoing enhancement of enterprise data platforms.

Skills

Python

Databricks

Spark/PySpark

SQL

Cloud platforms

Agile

Problem solving

Tools

Databricks

Airflow

Kafka

Docker

Kubernetes

Job description

GCS is seeking a Senior Data Engineer for a hybrid, contract role in the banking sector. The role focuses on hands-on engineering using Python, Databricks, Spark/PySpark and SQL, delivering scalable data platforms and analytics capabilities in a modern cloud environment.

You will design, develop and optimise pipelines, contribute to data platform stability and work with architects, engineers and stakeholders to drive efficient data solutions.