Senior Data Engineer

Care Quality Commission; United Kingdom; Remote; GBP 39,000 - 46,000; Full time

Job summary

A health and social care regulator is looking for a Senior Data Engineer to design and maintain cloud-based data pipelines using Azure Data Factory and Databricks. You will collaborate with teams to ensure data accuracy and deliver insights that improve care outcomes. This role requires expertise in Python for ETL workflows and a passion for supporting others in their professional growth.

Benefits

27-32.5 days annual leave

Training and development opportunities

NHS pension scheme

Wellbeing initiatives

Qualifications

• Experience in cloud-based data engineering using Azure Data Factory, Databricks, and SQL Server.
• Proficient in Python for building and improving ETL workflows.
• Ability to mentor and support team members.

Responsibilities

• Design and maintain cloud-based data pipelines.
• Manage ETL workflows for complex healthcare data.
• Collaborate with colleagues to solve data issues.

Skills

Cloud-based data engineering

Python

ETL workflows

Data lifecycle understanding

Mentorship

Tools

Azure Data Factory

Databricks

SQL Server

Job description

Overview

Grade B: £39,784 (National) or £45,456 (London - for London officebased or homebased workers within the boundary of the M25). There is also an additional homeworking allowance of £581 per annum for those working from home. For part time roles, this will be pro rata.

ContractedHours: Full time 37 hours per week. We may also consider compressed hours.

ContractType: Permanent

Location: Home based

Closing Date: Tuesday 11 November 2025 at 11.59pm

Make a Difference

At the Care Quality Commission (CQC), over 3,000 people end each day knowing they've helped improve lives. We make sure health and social care services across England are safe, kind, and high-quality—and we support them to get even better. Every role at CQC matters. Whether you're working with data, supporting inspections, or shaping policy, you'll be part of a team that cares deeply about making a difference. If you're someone who acts with integrity, works well with others, and wants to help improve care for people, we'd love to hear from you.

Picture This

In the last 12 months, as a Senior Data Engineer you would have gained:

• Expertise in cloud-based data engineering - You have experience creating strong, scalable data solutions using Azure Data Factory, Databricks, and SQL Server. You're confident using Python to build and improve ETL workflows and automate data processes.
• Understanding of the full data lifecycle - You know how to model, organise, and process data efficiently. You use this knowledge to build reliable systems that perform well and grow with the organisation's needs.
• Leadership and collaboration skills - You support others by sharing knowledge, mentoring teammates, and encouraging good technical practices. You care about the quality of your work and help those around you succeed.
• Impactful innovation - You've created tools and services that make data easier to understand and use—helping teams make better decisions and deliver better outcomes.

You'll Play a Key Role By:

• Designing, building and maintaining cloud-based data pipelines using Azure Data Factory, Databricks, Python, and SQL.
• Creating and managing ETL workflows to ingest, transform and prepare complex healthcare data for use.
• Working with colleagues to solve data issues, improve performance, and ensure data is accurate and available.
• Translating business needs into secure, scalable technical solutions that support CQC's mission.
• Supporting and mentoring team members to build a collaborative, high-performing environment.

Show Us

• Experience building scalable data solutions using Azure Data Factory, Databricks, and SQL Server to support complex projects.
• Ability to create and improve ETL workflows using Python, with a focus on automation and performance across cloud-based systems.
• Experience mentoring others and sharing best practices to support a collaborative, high-performing team.
• Ability to design tools and services that make data easier to understand and use, helping teams make better decisions.

To progress your application, you'll need to provide evidence of your right to work in the UK. Without valid right to work you won't be eligible for the role. We are unable to offer sponsorship for this role. Some roles may also be subject to a satisfactory DBS check.

Next steps

If you apply, you'll need to create a profile and complete an online application form. Your application will be completely anonymous. Please see our information for applicants for more details on the process. We contact every applicant to let them know the outcome of their application, so you will hear from us whether or not you are shortlisted.

You can read the full details of the role in the Job Description. If you'd like an informal chat about the role contact - Ravi Venkatramana, Principal Engineer, [e-mail]. For general enquiries, please email [e-mail].

The Benefits

We offer a wide range of benefits, including:

• Annual leave starting at 27 days per year, rising to 32.5 days with service, plus bank holidays (usually 8 days per year).
• Training and development opportunities.
• Wellbeing initiatives, such as gym discounts and meditation.
• NHS pension scheme, with around 14% employer contribution.
• Discount schemes (including eligibility for a Blue Light card, at a cost of £4.99 and valid for 2 years), reward vouchers, car leasing and more!

Please see our benefits page for the full list.

Equity for all

We know job descriptions can feel intimidating. Research shows they can cause some people to doubt whether they're a good fit. This happens more often to people from underrepresented groups (e.g. ethnic minority backgrounds). If this role interests you, we encourage you to apply. Your unique perspective, skills, and experience could be exactly what we need. We want every candidate to feel supported and able to do their best. If you need adjustments to our process, we\'ll work with you to remove any barriers. Visit our accessibility page for more on this. If you\'d like to chat, please contact [e-mail]. Please note, if you have previously informed us of adjustments you need for interview or within your role these are not carried over and must be discussed for each individual application you make.

We promote a workplace where fairness, respect and inclusion are a priority. Diverse teams make our work better, help us deliver our mission and make our culture stronger. See our ED&I page for more about this. We welcome applications from everyone, and colleagues can find support and community among our many employee networks. This includes people of any:

• Age
• Sex
• Gender identity or expression
• Sexual orientation
• Religion or belief
• Ethnicity
• Disability

Values and visionWe are guided by our core values, which shape our work and our culture.
Excellence - being a high-performing organisation.
Caring - treating everyone with dignity and respect.
Integrity - doing the right thing.
Teamwork - learning from each other to be the best we can. We are a disability confident employer and a carer confident employer.

A Note on AIAI tools can be great for research and refining ideas, but we want to learn about you. If you use AI or Chatbots to help you with your application, keep these points in mind:

• AI can support research, structuring and refining your writing, but your application must reflect your real skills and experience.
• Spell-checking and condensing word counts are great ways to use AI effectively.
• Do not copy and paste AI generated answers. These will not help you stand out; we want to hear about your skills and experience.
• Providing false and insincere examples goes against our core values of honesty and integrity and may lead to your application being withdrawn or termination of your employment.