Lead Data Engineer - Scale Pipelines & Lead Team (London)

X4 Technology; Greater London; Hybrid; GBP 86,000 - 105,000; Full time

Job summary

X4 Technology in London is seeking a Lead Data Engineer to grow our Data & AI practice. You will lead a small team, own end-to-end data capabilities, and work directly with clients to scope and deliver on Palantir Foundry and Spark-based pipelines.

The role requires hands-on data engineering with strong modelling and the ability to communicate complex designs clearly. London-based with 2 days per month on site, permanent employment.

Qualifications

• Experience leading data engineers on data-heavy systems.
• Strong knowledge of Spark and distributed processing tools.
• Able to explain technical design clearly to non-technical stakeholders.
• Hands-on with building data pipelines and modern data platforms.

Responsibilities

• Lead a small team of engineers and own components end-to-end: design, build, test, fix.
• Stay hands-on, building data pipelines at scale on Palantir Foundry, Spark and the cloud.
• Set engineering standards and coach the team to meet them.
• Work directly with clients, scope work and help shape proposals.
• Manage and develop team members and performance.
• Engage with Palantir Foundry projects; utilise Spark/databricks where appropriate.

Skills

Leadership

Team management

Data pipelines

Spark

Databricks

Palantir Foundry

Cloud

Communication

Tools

Palantir Foundry

Spark

Databricks

Job description

X4 Technology in London is seeking a Lead Data Engineer to grow our Data & AI practice. You will lead a small team, own end-to-end data capabilities, and work directly with clients to scope and deliver on Palantir Foundry and Spark-based pipelines.

The role requires hands-on data engineering with strong modelling and the ability to communicate complex designs clearly. London-based with 2 days per month on site, permanent employment.