Lead Data Engineer - Build Scalable AI Pipelines (Equity)

Acceler8

Greater London

On-site

GBP 144,000 - 176,000

Full time

4 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Ownership of data architecture
Onsite London 4 days a week
Work with founders

Job summary

Acceler8 Talent seeks a Lead Data Engineer in London to own building data infrastructure for an early-stage AI startup. You will architect scalable pipelines, guide vector and NoSQL data strategies and partner with AI, backend, and product teams to deliver high-impact systems.

You will lead and mentor engineers, drive data quality, observability and security, while remaining hands-on to shape long-term data platform strategy.

Qualifications

  • 7+ years of experience in Data Engineering or closely related engineering disciplines.
  • Strong commercial Python experience.
  • Proven experience architecting and building scalable data pipelines and distributed systems.
  • Experience managing engineers, including team development and technical delivery.
  • Strong knowledge of relational databases, particularly PostgreSQL.
  • Experience working with NoSQL databases.
  • Experience with vector databases or vector search technologies.
  • Hands-on experience with Kafka, Apache Spark, Apache Airflow or Elasticsearch.
  • Strong understanding of data modelling, storage architectures and performance optimisation.
  • Ability to take ownership of complex technical projects from initial design through to production.

Responsibilities

  • Architect, design and build scalable data pipelines and infrastructure supporting AI-powered products.
  • Develop and optimise batch and real-time data processing systems.
  • Build data ingestion, transformation and storage architectures.
  • Design and implement vector database infrastructure, retrieval systems and ML data pipelines.
  • Own technical decisions around data architecture, tooling, reliability and scalability.
  • Work closely with AI, backend and product engineering teams.
  • Establish best practices around data quality, monitoring, security and observability.
  • Lead, mentor and develop engineers, helping build the future data engineering function.
  • Remain technically hands-on while driving engineering delivery and long-term strategy.

Skills

Data engineering
Python
Data pipelines
Team leadership
PostgreSQL
NoSQL
Vector databases
Kafka
Spark
Airflow
Elasticsearch
Data modelling

Tools

Kafka
Apache Spark
Apache Airflow
Elasticsearch
PostgreSQL

Job description

Acceler8 Talent seeks a Lead Data Engineer in London to own building data infrastructure for an early-stage AI startup. You will architect scalable pipelines, guide vector and NoSQL data strategies and partner with AI, backend, and product teams to deliver high-impact systems.

You will lead and mentor engineers, drive data quality, observability and security, while remaining hands-on to shape long-term data platform strategy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer – AI Startup | Equity & Impact
Lead Data Engineer – AI Startup | Equity & Impact

Understanding Recruitment • Greater London

On-site
GBP 144,000 - 176,000
Equity
Lead Data Engineer – AI Startup | London | Equity
Lead Data Engineer – AI Startup | London | Equity

Understanding Recruitment Ltd • Greater London

On-site
GBP 144,000 - 176,000
Equity
Lead Data Engineer: Build & Scale AI Data Pipelines
Lead Data Engineer: Build & Scale AI Data Pipelines

Datatech Analytics • City Of London

On-site
GBP 81,000 - 99,000
Lead Data Engineer – Equity & Real-Time AI Pipelines
Lead Data Engineer – Equity & Real-Time AI Pipelines

Hexwired Recruitment Limited • Greater London

Hybrid
GBP 80,000 - 115,000
Equity options
Ownership and autonomy
Direct collaboration with founders
+1
Lead Data Engineer - Real-Time Pipelines & AI Infra
Lead Data Engineer - Real-Time Pipelines & AI Infra

Hexwired Recruitment Limited • City Of London

Hybrid
GBP 80,000 - 115,000
Equity options
Lead Data Engineer
Lead Data Engineer

Hexwired Recruitment Limited • City Of London

Hybrid
GBP 80,000 - 115,000
Equity options
Lead Data Engineer
Lead Data Engineer

Hexwired Recruitment Limited • Greater London

Hybrid
GBP 80,000 - 115,000
Equity options
Ownership and autonomy
Direct collaboration with founders
+1
Data Engineer
Data Engineer

Understanding Recruitment • Greater London

On-site
GBP 144,000 - 176,000
Equity
Lead Data Engineer - Hybrid (London)
Lead Data Engineer - Hybrid (London)

Datatech Analytics • City Of London

Hybrid
GBP 85,000 - 95,000
Lead Data Engineer: Architect AI‑Driven Data Platforms
Lead Data Engineer: Architect AI‑Driven Data Platforms

DataTruth Ltd • Greater London

Hybrid
GBP 90,000 - 150,000
25 days leave
London hybrid
MacBook Pro
+1