Senior Data Engineer

Transform; Greater London; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Holiday entitlement 28 days + buy/sell

Birthday off

Pension eligibility

Life assurance

Enhanced parental leave

Cycle to work

Flexible benefits

Job summary

Transform is seeking a Senior Data Engineer to design, build, and maintain scalable data solutions within an Agile delivery team. You will ensure data is accessible, reliable, secure, and fit for purpose.

You'll collaborate with engineers, product owners, data analysts, and data scientists to translate requirements into robust technical solutions and champion data quality and security across cloud-based platforms.

Qualifications

• Proven experience designing, building and delivering production-ready data pipelines.
• Strong SQL and Python expertise with reusable frameworks.
• Experience designing data solutions on cloud platforms (Azure/AWS).
• Hands-on with data platforms like Azure Data Factory, Databricks, Snowflake.
• Ability to collaborate with cross-functional teams in Agile environments.
• Experience mentoring junior to mid-level Data Engineers (beneficial).

Responsibilities

• Working with clients to understand needs and implement the best data solution.
• Building and configuring complex end-to-end data pipelines.
• Delivering in fast-paced environments where requirements evolve.
• Collaborate within agile, cross-functional teams to deliver high-quality data solutions.

Skills

Data engineering principles

Production-ready pipelines

SQL

Python

Data quality controls

Cloud (Azure/AWS)

Azure Data Factory/Databricks/Snowlake

Diverse data sources

CI/CD tooling

Mentoring juniors

Vector databases/knowledge graphs

AI for development

Job description

Please note: Sponsorship is not available for this role, now or in the future. Applicants must have full and unrestricted right to work in the UK. Please do not apply if you require sponsorship currently or may require it in the future.

About Us:

We're Transform.

Transform is a fresh alternative to Big Consulting. As an end-to-end transformation partner, we define, design, build and operate systems that solve our clients’ toughest challenges and seize their biggest opportunities. That often means combining strategy, data, AI, technology, and change management. Sometimes we manage and operate the systems we create; other times, we hand it over for the client to run - standing by to make improvements when things change. It all comes down to making an impact: improving lives, supporting citizens, streamlining workflows, and making the world a better place. We specialise in public sector and public-facing organisations - from government agencies and local authorities to energy, utilities, transportation and healthcare. We also work for some of the world’s most dynamic brands across automotive, retail, financial services, and consumer goods. We work closely (often on site) with our clients; to deliver impact you are keen to help us build the workforce of the future, we should talk.

We're all in! That's what gets us out of bed every day. We hope you feel the same.

The Role:

The Senior Data Engineer will play a key role within an Agile delivery team to design, build, and maintain robust, scalable data solutions. You will contribute to the delivery of a range of data products that support business intelligence, reporting, analytics, and AI-driven use cases, ensuring data is accessible, reliable, secure, and fit for purpose.

Working collaboratively across multidisciplinary teams, you will engage closely with other engineers, product owners, business analysts, data architects, data analysts, project managers, and data scientists to understand business requirements and translate them into effective technical solutions. You will be responsible for developing and optimising data pipelines and integrating diverse data sources within cloud-based data platforms.

As a senior member of the team, you will provide technical guidance, promote engineering best practices, and contribute to the continuous improvement of delivery processes, tooling, and standards. You will champion data quality, ensuring that solutions are scalable, maintainable, and aligned with organisational and regulatory requirements.

We are looking for individuals who bring a growth mindset and a passion for continuous learning. You will be curious about emerging technologies, particularly within the AI and data landscape, and proactive in identifying opportunities to innovate and improve delivery.

Key Responsibilities:

• Working with clients to understand their needs, and implement the best technological solution
• Building and configuring complex end-to-end data pipelines
• Delivering in fact-paced environments where requirements may evolve over time
• Collaborate effectively within agile, cross-functional teams to deliver high-quality data solutions

Key Skills/Experiences:

• Solid foundations in data engineering principles and best practices
• Proven experience of designing, building and delivering production-ready data pipelines
• Strong communication skills, with the ability to engage and influence stakeholders at all levels
• Strong SQL and Python expertise, with experience in the development of reusable frameworks and components
• Strong understanding of data quality and experience embedding appropriate controls throughout the data platform and delivery lifecycle
• Significant experience designing and delivering data solutions on cloud platforms such as Azure or AWS
• Hands-on experience with modern data engineering platforms and services, such as Azure Data Factory, Databricks, Fabric, Snowflake or equivalent technologies
• Experience working with a diverse range data sources, including structured and semi-structured data
• Understanding of CI/CD tooling and processes used to support reliable and efficient deployments
• Experience of mentoring junior to mid-level Data Engineers would be beneficial
• Experience of vector databases or knowledge graphs
• Experience of using AI to assist development

Our culture is built on:

• We raise the bar
• We look out for each other
• We shape a changing world

Our benefits include:

• Holiday entitlement, 28 days with the option to buy/sell up to 5 days (note that 3 days are held for Christmas holidays)
• Day off (on or in the week of) your birthday
• Pension eligibility, up to 5% matched contributions
• Life assurance
• Enhanced maternity and enhanced paternity and shared parental leave
• Cycle to work schemes
• A range of other benefits from our flexible benefits package

At Transform, you can expect meaningful work, with real impact and the space to grow as people as well as a professional.

You’ll work alongside curious, authentic experts who care deeply about doing the right thing, for our clients and for each other with no egos, no blame, and no standing on the sidelines.

We’re all in on creating an environment where people feel supported, included and trusted to do their best work. In return, we ask for curiosity, honesty and a willingness to lean into learning, quality, teamwork, and to making change that truly lasts.

We’re committed to equality of opportunity for all, and we actively seek applications from all ethnicities, orientations, beliefs, gender identities + those with neurodiverse traits and disabilities. We want you to have the best opportunity to show us who you are and what you can do. Please do let us know if you need any adjustments now or at any point in the recruitment process.

Use of AI in CV and Interviews

We value authenticity and transparency in our hiring process. To ensure fairness and accuracy in assessing your skills and experience, we ask that you refrain from using AI-assisted tools to generate answers during the application process or within interviews.

We are looking for genuine insights into your abilities, experiences, and personality. Any misrepresentation through AI-generated content may impact our ability to make an informed decision. We look forward to getting to know the real you!