Lead Data Engineer

Impellam; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Guidant Global is seeking a senior data engineer to design and operate enterprise-scale data pipelines and platforms. You will lead end-to-end data initiatives, collaborating with delivery teams and stakeholders to translate complex problems into robust data solutions.

You will work with Python and Spark to build production-grade pipelines, improve data quality and governance, and mentor others to raise engineering standards. The role emphasizes hands-on delivery and systemic problem solving.

Qualifications

• Significant hands‑on experience as a senior or lead data engineer on complex, real‑world systems.
• Strong Python and Spark production data pipelines experience.
• Understanding of data governance, security and compliance built into systems by design.

Responsibilities

• Design, build and improve enterprise-scale data pipelines, platforms and services.
• Lead complex data engineering work end to end, from problem definition through build and operational use.
• Work directly with technical and non‑technical stakeholders to translate real problems into effective data solutions.
• Engineer data integrations across diverse systems, including legacy and modern platforms.
• Build production‑grade data solutions using strong software and data engineering practices.
• Improve data quality, lineage and metadata as first‑class engineering concerns.
• Diagnose and resolve complex data and platform issues in constrained environments.
• Provide technical leadership and raise standards through example and delivery.

Skills

Senior data engineer experience

Python

Spark

Data modeling

Data governance

Messy data handling

Delivery leadership

Tools

Spark

Python

Job description

Working Environment

Data engineering work is grounded in real operational needs, often involving imperfect data, technical constraints and organisational complexity. Engineers work closely with delivery teams and stakeholders to understand problems end to end and deliver robust, production-grade solutions.

Collaboration, pragmatism and persistence are valued, alongside strong engineering craft.

What You’ll Be Doing

• Design, build and improve enterprise-scale data pipelines, platforms and services
• Lead complex data engineering work end to end, from problem definition through build and operational use
• Work directly with technical and non-technical stakeholders to translate real problems into effective data solutions
• Engineer data integrations across diverse systems, including legacy and modern platforms
• Build production-grade data solutions using strong software and data engineering practices
• Improve data quality, lineage and metadata as first-class engineering concerns
• Diagnose and resolve complex data and platform issues in constrained environments
• Provide technical leadership and raise standards through example and delivery

Your Experience

• Significant hands‑on experience as a senior or lead data engineer on complex, real‑world systems
• Strong Python and Spark skills, with evidence of building and maintaining production data pipelines
• Deep understanding of the data engineering lifecycle: ingestion, transformation, storage and serving
• Experience designing data models that support operational and analytical use
• Understanding of data governance, security and compliance built into systems by design
• Confidence working with messy data, legacy constraints and organisational complexity
• Ability to influence through technical delivery rather than formal authority

In Return

You’ll work on meaningful data engineering challenges that support real outcomes across the organisation.

This is an opportunity to stay hands‑on, tackle difficult data problems, and shape better data practices through delivery rather than abstraction.

As an organisation and as a team, Guidant Global are committed to fostering an equitable, diverse and inclusive workplace, where every employee and contractor feels valued and empowered throughout their time with us.

We actively seek to recruit talent from all backgrounds, and to draw on a rich blend of experiences, perspectives and creativity. We believe that when people are respected and included, they are motivated to bring their best and whole selves to work, leading to innovative solutions and exceptional outcomes for all parties.

Guidant Global is acting as an Employment Business in relation to this vacancy.