Data Engineer (Databricks and AWS)

Free-Work UK; Leeds; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Competitive salary

Excellent pension

Private healthcare

Share scheme

Job summary

CGI is seeking a Senior Data Engineer to design, build and optimise data platforms supporting national healthcare services. You will utilise Databricks, Apache Spark and Python to create scalable pipelines and data solutions on AWS (S3, Glue, Lambda).

You’ll collaborate with cross-functional teams, govern data with NHS standards, and push for continual improvement while working in a hybrid role based in Leeds.

Qualifications

• Hands-on data engineering experience with cloud-based data platforms.
• Experience in regulated or healthcare environments is advantageous.

Responsibilities

• Design & Build: Develop data pipelines with Databricks, Spark, and Python.
• Develop & Deliver: Build scalable data solutions on AWS (S3, Glue, Lambda).
• Integrate & Automate: Implement ETL and data lake/lakehouse architectures.
• Collaborate & Advise: Work with stakeholders to translate requirements into data solutions.
• Secure & Govern: Ensure governance, NHS standards, and security controls.
• Innovate & Improve: Drive ongoing improvements in data engineering practices.

Skills

Databricks

Apache Spark

Python

SQL

ETL design

Data governance

Cloud data solutions

Education

Tools

AWS S3

AWS Glue

AWS Lambda

IAM

Job description

At CGI, we’re helping to transform the future of healthcare through the power of data. As a Senior Data Engineer, you’ll play a pivotal role in designing, building, and optimising data platforms that underpin critical national services. Working at the heart of our Healthcare team, you’ll use your expertise in AWS, Databricks, and Python to deliver high-impact solutions that improve outcomes, enhance decision-making, and drive innovation across the sector. You’ll collaborate with experts who share your passion for problem-solving, ownership, and technical excellence—empowered to shape the data foundations of tomorrow.

CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times.

We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee.

• competitive salary
• excellent pension
• private healthcare
• share scheme (3.5% + 3.5% matching)

We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant.

Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go.

Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position based in Leeds.

Candidate Profile

In this role, you will design, build, and maintain data solutions that power some of the UK’s most critical healthcare systems. You’ll be part of a collaborative engineering team, transforming how data is captured, processed, and used to drive better patient and operational outcomes. Your work will combine technical innovation with practical delivery—enabling data accessibility, quality, and security at scale.

You’ll take ownership of complex data challenges, partner with architects and analysts to shape technical direction, and continuously refine processes to deliver efficient, sustainable data pipelines. Working within CGI’s supportive environment, you’ll be encouraged to explore new technologies, share knowledge, and contribute to a culture of excellence and innovation.

• Design & Build: Develop and optimise data pipelines using Databricks, Apache Spark, and Python.
• Develop & Deliver: Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services.
• Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability.
• Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data solutions.
• Secure & Govern: Ensure compliance with data governance, NHS standards, and security frameworks.
• Innovate & Improve: Drive continuous improvement across data engineering practices and technologies.

Required Qualifications To Be Successful In This Role

To excel in this role, you’ll bring strong data engineering expertise and hands‑on experience in cloud‑based data solutions, ideally within regulated or complex environments such as healthcare. You’ll be confident in both the technical and consultative aspects of data delivery.

You Must Have

• Hands‑on commercial expertise with Databricks.

You Should Have

• Proven experience as a Data Engineer working with large, complex datasets.
• Hands‑on expertise with Apache Spark, and SQL.
• Strong proficiency in Python (PySpark preferred).
• Experience with AWS cloud services including S3, Glue, Lambda, IAM.
• Familiarity with ETL design, data modelling, and data lake/lakehouse concepts.
• Understanding of data governance and compliance frameworks.
• Experience in the healthcare sector or knowledge of NHS data standards (advantageous).