Data Engineer (Databricks and AWS)

Free-Work UK; Leeds; Hybrid; GBP 70,000 - 95,000; Full time

Benefits offered by this job

Excellent pension

Private healthcare

Share scheme (3.5% + 3.5% matching)

Job summary

CGI is recruiting a Senior Data Engineer to design, build and optimise data platforms for critical UK healthcare systems. You will work on Databricks, Spark, Python and AWS-based data pipelines, ensuring data quality, security and compliance.

Hybrid role based in Leeds with NHS data standards awareness valued. You will take ownership of complex data challenges, collaborate with architects and analysts, and drive innovation across data engineering practices while contributing to a culture of

Qualifications

• Hands-on data engineering experience with cloud-based data solutions in regulated environments.
• Strong knowledge of Databricks, Spark, SQL and Python for building data pipelines.
• Experience with AWS services (S3, Glue, Lambda, IAM) and data lake/lakehouse concepts.
• Understanding of data governance, security, and NHS data standards is advantageous.

Responsibilities

• Design, build, and maintain scalable data pipelines across platforms.
• Collaborate with architects and analysts to shape technical direction.
• Deliver secure, compliant data solutions in healthcare contexts.
• optimise data platforms for quality, accessibility and performance.
• Drive continuous improvement in data engineering practices and tooling.

Skills

Databricks

Apache Spark

Python

SQL

AWS

Data governance

NHS data standards

Tools

Databricks

Apache Spark

AWS (S3/Glue/Lambda/IAM)

Python (PySpark)

SQL

Job description

At CGI, we’re helping to transform the future of healthcare through the power of data. As a Senior Data Engineer, you’ll play a pivotal role in designing, building, and optimising data platforms that underpin critical national services. Working at the heart of our Healthcare team, you’ll use your expertise in AWS, Databricks, and Python to deliver high-impact solutions that improve outcomes, enhance decision-making, and drive innovation across the sector. You’ll collaborate with experts who share your passion for problem-solving, ownership, and technical excellence—empowered to shape the data foundations of tomorrow.

CGI was recognised in the Sunday Times Best Places to Work List 2025 and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go.

Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position based in Leeds.

Candidate Profile

In this role, you will design, build, and maintain data solutions that power some of the UK’s most critical healthcare systems. You’ll be part of a collaborative engineering team, transforming how data is captured, processed, and used to drive better patient and operational outcomes. Your work will combine technical innovation with practical delivery—enabling data accessibility, quality, and security at scale.

You’ll take ownership of complex data challenges, partner with architects and analysts to shape technical direction, and continuously refine processes to deliver efficient, sustainable data pipelines. Working within CGI’s supportive environment, you’ll be encouraged to explore new technologies, share knowledge, and contribute to a culture of excellence and innovation.

• Design & Build: Develop and optimise data pipelines using Databricks, Apache Spark, and Python.
• Develop & Deliver: Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services.
• Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability.
• Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data solutions.
• Secure & Govern: Ensure compliance with data governance, NHS standards, and security frameworks.
• Innovate & Improve: Drive continuous improvement across data engineering practices and technologies.

Required Qualifications To Be Successful In This Role

To excel in this role, you’ll bring strong data engineering expertise and hands‑on experience in cloud‑based data solutions, ideally within regulated or complex environments such as healthcare. You’ll be confident in both the technical and consultative aspects of data delivery.

You Must Have

• Hands‑on commercial expertise with Databricks.

You Should Have

• Proven experience as a Data Engineer working with large, complex datasets.
• Hands‑on expertise with Apache Spark, and SQL.
• Strong proficiency in Python (PySpark preferred).
• Experience with AWS cloud services including S3, Glue, Lambda, IAM.
• Familiarity with ETL design, data modelling, and data lake/lakehouse concepts.
• Understanding of data governance and compliance frameworks.
• Experience in the healthcare sector or knowledge of NHS data standards (advantageous).