Senior Data Engineer - Private Sector

Spinwell Global; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A global recruitment firm seeks a Senior Data Engineer for a 6-month hybrid contract in London. The candidate will develop and maintain an Azure Databricks platform critical for economic data analysis. Key responsibilities include building and optimising data pipelines, and ensuring data quality. Candidates should have extensive data engineering experience, particularly with Azure Databricks, Python, and various Azure services. This opportunity promotes diversity and equality in the workplace.

Qualifications

• 10+ years of experience in data engineering.
• 3+ years hands-on experience with Azure Databricks.
• Strong understanding of data engineering principles.
• Experience with large datasets and complex data pipelines.

Responsibilities

• Contribute to the development of Azure Databricks platform.
• Build and optimise data pipelines.
• Ensure data quality and reliability.

Skills

Data engineering

Azure Databricks

Python

Spark (PySpark)

Data warehousing principles

Data modelling techniques

Azure Data Factory

SQL

Agile development methodologies

Docker

Education

Azure Data Engineer Associate certification

Tools

Azure Blob Storage

Tableau

Power BI

Job description

Role: Senior Data Engineer
Contract Length: 6 months extendable
Location: Hybrid/London – 3 days per week in office
IR35: Inside
Pay Rate to Intermediary: Market Rate
Security Clearance: SC requested

Spinwell is recruiting for a Senior Data Engineer for an excellent opportunity within the public sector.

RESPONSIBILITIES OF THE SENIOR DATA ENGINEER

The client is seeking a highly skilled and experienced Senior Data Engineer to join their team and contribute to the development and maintenance of their cutting-edge Azure Databricks platform for economic data. This platform is critical for their Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets.

SKILLS/EXPERIENCE OF THE SENIOR DATA ENGINEER

• 10+ years of experience in data engineering, with at least 3+ years of hands‑on experience with Azure Databricks.
• Good proficiency in Python and Spark (PySpark) or Scala.
• Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.
• Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.
• Experience working with large datasets and complex data pipelines.
• Experience with data architecture design and data pipeline optimisation.
• Proven expertise with Databricks, including hands‑on implementation experience and certifications.
• Experience with SQL and NoSQL databases.
• Experience with data quality and data governance processes.
• Experience with version control systems (e.g., Git).
• Experience with Agile development methodologies.
• Excellent communication, interpersonal, and problem‑solving skills.
• Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs).
• Experience with data visualisation tools (e.g., Tableau, Power BI).
• Experience with DevOps tools and practices (e.g., Azure DevOps, Jenkins, Docker, Kubernetes).
• Experience working in a financial services or economic data environment.
• Azure certifications related to data engineering (e.g., Azure Data Engineer Associate

If you are a Senior Data Engineer, apply now or send your CV to Spinwell!

We welcome all applications regardless of background, in line with our commitment to diversity, equality and inclusion.

Applying to this or any other vacancy advertised by Spinwell Ltd constitutes an agreement for Spinwell Ltd to hold your details for 24 months for the purpose of assessing suitability for the advertised position and to make you aware of any other positions deemed suitable of which you will be made aware by means of either email, text or phone. In line with GDPR regulations you are able to request your details be removed from the company data at any time by emailing us