Data Engineer

Acceler8

Greater London

On-site

GBP 144,000 - 176,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Ownership of data architecture
Onsite London 4 days a week
Work with founders

Job summary

Acceler8 Talent seeks a Lead Data Engineer in London to own building data infrastructure for an early-stage AI startup. You will architect scalable pipelines, guide vector and NoSQL data strategies and partner with AI, backend, and product teams to deliver high-impact systems.

You will lead and mentor engineers, drive data quality, observability and security, while remaining hands-on to shape long-term data platform strategy.

Qualifications

  • 7+ years of experience in Data Engineering or closely related engineering disciplines.
  • Strong commercial Python experience.
  • Proven experience architecting and building scalable data pipelines and distributed systems.
  • Experience managing engineers, including team development and technical delivery.
  • Strong knowledge of relational databases, particularly PostgreSQL.
  • Experience working with NoSQL databases.
  • Experience with vector databases or vector search technologies.
  • Hands-on experience with Kafka, Apache Spark, Apache Airflow or Elasticsearch.
  • Strong understanding of data modelling, storage architectures and performance optimisation.
  • Ability to take ownership of complex technical projects from initial design through to production.

Responsibilities

  • Architect, design and build scalable data pipelines and infrastructure supporting AI-powered products.
  • Develop and optimise batch and real-time data processing systems.
  • Build data ingestion, transformation and storage architectures.
  • Design and implement vector database infrastructure, retrieval systems and ML data pipelines.
  • Own technical decisions around data architecture, tooling, reliability and scalability.
  • Work closely with AI, backend and product engineering teams.
  • Establish best practices around data quality, monitoring, security and observability.
  • Lead, mentor and develop engineers, helping build the future data engineering function.
  • Remain technically hands-on while driving engineering delivery and long-term strategy.

Skills

Data engineering
Python
Data pipelines
Team leadership
PostgreSQL
NoSQL
Vector databases
Kafka
Spark
Airflow
Elasticsearch
Data modelling

Tools

Kafka
Apache Spark
Apache Airflow
Elasticsearch
PostgreSQL

Job description

Lead Data Engineer | AI Startup | Up to £160,000 + Equity
The Opportunity

We're partnering with an ambitious, early-stage AI startup that's building an intelligent platform to transform how an entire industry operates.

They're looking for a Lead Data Engineer to take ownership of their data infrastructure, shape the technical architecture and build the foundations of a high-performing data engineering team.

This is an opportunity to join at an early stage, work directly with the founders and have genuine ownership over the systems powering a rapidly scaling AI product.

Rather than inheriting an established data platform, you'll have the autonomy to build, architect and scale it from the ground up.

What You'll Be Doing
  • Architect, design and build scalable data pipelines and infrastructure supporting AI-powered products.
  • Develop and optimise batch and real-time data processing systems.
  • Build data ingestion, transformation and storage architectures.
  • Design and implement vector database infrastructure, retrieval systems and ML data pipelines.
  • Own technical decisions around data architecture, tooling, reliability and scalability.
  • Work closely with AI, backend and product engineering teams.
  • Establish best practices around data quality, monitoring, security and observability.
  • Lead, mentor and develop engineers, helping build the future data engineering function.
  • Remain technically hands-on while driving engineering delivery and long-term strategy.
What We're Looking For
  • 7+ years of experience in Data Engineering or closely related engineering disciplines.
  • Strong commercial Python experience.
  • Proven experience architecting and building scalable data pipelines and distributed systems.
  • Experience managing engineers, including team development and technical delivery.
  • Strong knowledge of relational databases, particularly PostgreSQL.
  • Experience working with NoSQL databases.
  • Experience with vector databases or vector search technologies.
  • Hands‑on experience with technologies such as Kafka, Apache Spark, Apache Airflow or Elasticsearch.
  • Strong understanding of data modelling, storage architectures and performance optimisation.
  • Ability to take ownership of complex technical projects from initial design through to production.
Nice to Have
  • Experience with vector databases such as pgvector, Qdrant, Milvus or Pinecone.
  • Previous experience building AI/ML infrastructure, RAG pipelines or retrieval systems.
  • Experience with AWS, GCP or Azure.
  • Exposure to Node.js or JavaScript.
  • Experience working within early-stage startups or high‑growth technology companies.
  • Experience building data engineering teams or infrastructure from scratch.
Why Join?
  • Up to £160,000 base salary + equity.
  • Join an early-stage AI company with ambitious growth plans.
  • Take ownership of the entire data architecture and infrastructure.
  • Work directly with the founders and senior engineering team.
  • Build and shape a data engineering function from its earliest stages.
  • Work with modern AI technologies, distributed systems and large‑scale data infrastructure.
  • Have a genuine influence on technical direction, product development and company growth.

Location: London – 4 days per week onsite.

Please note: Candidates must already have the right to work in the UK without visa sponsorship.

If you're an experienced Data Engineering leader who enjoys building systems from scratch, leading talented engineers and solving complex infrastructure challenges, we'd love to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Hexwired Recruitment Limited • Greater London

Hybrid
GBP 80,000 - 115,000
Equity options
Ownership and autonomy
Direct collaboration with founders
+1
Lead Data Engineer
Lead Data Engineer

Hexwired Recruitment Limited • City Of London

Hybrid
GBP 80,000 - 115,000
Equity options
Data Engineer
Data Engineer

Understanding Recruitment • Greater London

On-site
GBP 144,000 - 176,000
Equity
Data Engineer
Data Engineer

Understanding Recruitment • Greater London

On-site
GBP 144,000 - 176,000
Equity
Data Engineer
Data Engineer

Senzo • England

Hybrid
GBP 60,000 - 70,000
Competitive salary
Equity
Hybrid working
+1
Lead Data Engineer – AI Startup | London | Equity
Lead Data Engineer – AI Startup | London | Equity

Understanding Recruitment Ltd • Greater London

On-site
GBP 144,000 - 176,000
Equity
Lead Data Engineer - London
Lead Data Engineer - London

Datatech Analytics • City Of London

Hybrid
GBP 85,000 - 95,000
Lead Data Engineer
Lead Data Engineer

Xcede • England

Hybrid
GBP 90,000 - 130,000
Flexible hybrid working approach
Opportunity for leadership responsibilities with technical delivery
Influence over next-generation data and AI capabilities
Lead Data Engineer – AI Startup | Equity & Impact
Lead Data Engineer – AI Startup | Equity & Impact

Understanding Recruitment • Greater London

On-site
GBP 144,000 - 176,000
Equity
Lead Data Engineer
Lead Data Engineer

Lorien • England

On-site
GBP 90,000 - 120,000