Data Engineer - SC Cleared

Lorien

Greater London

Hybrid

GBP 92.000 - 138.000

Teilzeit

Vor 2 Tagen
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Lorien is seeking an experienced Data Engineer for a 6‑month contract in London. The role is hybrid with 50% onsite work and requires Active SC Clearance. The project focuses on designing and delivering a modern, cloud‑first data platform for a leading UK financial sector organisation.

You will design scalable data solutions on Azure, develop robust pipelines with Python/SQL/Spark, and lead data governance and quality initiatives while modernising legacy systems and guiding migrations to Azure.

Qualifikationen

  • Extensive experience with Azure data services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
  • Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing.
  • Proven experience in CI/CD practices using industry‑standard tools (eg, GitHub Actions, Azure DevOps).
  • Strong understanding of data architecture principles and cloud‑native design patterns.

Aufgaben

  • Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage.
  • Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake.
  • Champion strong data quality, governance and observability practices.
  • Modernise Legacy systems and support large‑scale migrations into Azure.
  • Provide technical leadership, set engineering standards and contribute to architectural decisions.
  • Mentor engineers and foster a culture of continuous improvement.
  • Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs.

Kenntnisse

SQL
Python
Spark/PySpark
Linux/Unix
Shell scripting

Tools

Azure Databricks
Azure Data Lake Storage
Azure Data Factory
GitHub Actions
Azure DevOps
Delta Lake
Apache Airflow

Jobbeschreibung

Data Engineer
6 Month Contract
Hybrid - London (50% onsite)
Please note: Active SC Clearance is required for this role

A leading organisation within the UK financial sector is embarking on a major data transformation programme. They are looking for an experienced Data Engineer to help design and deliver a modern, cloud-first data platform that will underpin some of the organisation's most critical functions.

Responsibilities
  • Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage.
  • Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake.
  • Champion strong data quality, governance and observability practices.
  • Modernise Legacy systems and support large‑scale migrations into Azure.
  • Provide technical leadership, set engineering standards and contribute to architectural decisions.
  • Mentor engineers and foster a culture of continuous improvement.
  • Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs.
Minimum Criteria
  • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
  • Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing.
  • Proven experience in CI/CD practices using industry‑standard tools (eg, GitHub Actions, Azure DevOps).
  • Strong understanding of data architecture principles and cloud‑native design patterns.
Essential Criteria
  • Demonstrated ability to lead technical delivery, mentor engineering teams and collaborate with stakeholders to ensure alignment between data solutions and business strategy.
  • Proficiency in Linux/Unix environments and Shell scripting.
  • Deep understanding of source control, testing strategies, and agile development practices.
  • Self‑motivated with a strategic mindset and a passion for driving innovation in data engineering.
Desirable Criteria
  • Experience delivering data pipelines on Hortonworks/Cloudera on‑prem and leading cloud migration initiatives.
  • Familiarity with:
    • Apache Airflow
    • Data modelling and metadata management
  • Experience influencing enterprise data strategy and contributing to architectural governance.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Data Engineer I SC Cleared
Data Engineer I SC Cleared

Matchtech • North East

Hybrid
GBP 72.000 - 92.000
Data Engineer
Data Engineer

Talent • Greater London

Hybrid
GBP 90.000 - 120.000
Senior Data Engineer
Senior Data Engineer

Ceox • Großbritannien

Remote
GBP 83.000 - 131.000
SC Cleared – Cloud Engineer (Databricks / Azure)
SC Cleared – Cloud Engineer (Databricks / Azure)

Montash • Großbritannien

Remote
GBP 63.837 - 83.763
Data Engineer / Architect | 6-Month Contract | Outside IR35 | £550-£650/day | Hybrid (London)
Data Engineer / Architect | 6-Month Contract | Outside IR35 | £550-£650/day | Hybrid (London)

Opus RS • Greater London

Hybrid
GBP 101.000 - 120.000
Data Engineer (SC Cleared)
Data Engineer (SC Cleared)

Auxo Talent • Greater London

Remote
GBP 50.000 - 70.000
Contract Data Engineer - SC Cleared
Contract Data Engineer - SC Cleared

Fruition Group • Großbritannien

Remote
GBP 92.000 - 138.000
Senior Data Engineer
Senior Data Engineer

TechNET • Leeds

Hybrid
GBP 83.000 - 129.000
Data Engineer
Data Engineer

Experis IT • Telford

Hybrid
GBP 83.000 - 92.000
Databricks Data Engineer
Databricks Data Engineer

GIS Recruiter Ltd • City Of London

Vor Ort
GBP 90.000 - 130.000