Lead Data Engineer: Architect AI‑Driven Data Platforms

DataTruth Ltd; Greater London; Hybrid; GBP 90,000 - 150,000; Full time

Benefits offered by this job

25 days leave

London hybrid

MacBook Pro

Competitive pay

Job summary

DataTruth Ltd in London is seeking a Lead Data Engineer to design, build and operate data platforms and ETL pipelines for client projects. You’ll shape architecture, lead hands‑on delivery, and collaborate with product owners, architects, engineers and QA to deliver robust data solutions.

You'll use cloud tech, AI-accelerated workflows, and modern tooling to solve complex data challenges while mentoring teams and ensuring security and data privacy best practices.

Qualifications

• Deep experience in data architecture and engineering best practices.
• Hands-on lead role with cloud data platforms and ETL pipelines.

Responsibilities

• Collaborate with clients and stakeholders to identify project requirements and define scope.
• Develop secure, robust data and technology solutions that solve real problems.
• Own the design, build, and operation of the data platform, pipelines, infrastructure, and integrations.
• Work with product owners, architects, engineers, designers, QA and other specialists.
• Advise clients on technical options and delivery estimates.
• Lead teams of experts, supporting their development and new challenges.
• Uphold high standards in data engineering, security and privacy.

Skills

SQL

dbt

dlt

data modelling

Python

Git

Docker

ETL pipelines

PostgreSQL

DuckDB

Airflow

Step Functions

Claude Code

Codex

AWS Lambda

AWS ECS

Data testing

Vendor selection

Data warehousing

CDK

CI/CD

Tools

Cloud data platforms

ETL pipelines

AI tooling

Job description

DataTruth Ltd in London is seeking a Lead Data Engineer to design, build and operate data platforms and ETL pipelines for client projects. You’ll shape architecture, lead hands‑on delivery, and collaborate with product owners, architects, engineers and QA to deliver robust data solutions.

You'll use cloud tech, AI-accelerated workflows, and modern tooling to solve complex data challenges while mentoring teams and ensuring security and data privacy best practices.