AI Data Engineering Lead

HartleyCo; Greater London; Remote; GBP 30,000 - 75,000; Full time

Job summary

An innovative firm is seeking a Lead Data Engineer to drive their machine learning initiatives. This role focuses on building and scaling ML training pipelines, particularly for video datasets at petabyte scale. You will collaborate closely with cross-functional teams to enhance data quality and streamline workflows. The company boasts a remote-first culture and is backed by top-tier investors, providing a dynamic environment where your contributions will significantly impact the future of AI and media. If you're passionate about data engineering and eager to work in a fast-paced setting, this opportunity is for you.

Qualifications

• Deep experience with ML data pipelines is essential.
• Expertise with petabyte-scale datasets, ideally video-heavy.

Responsibilities

• Own and scale ML training pipelines for video datasets.
• Architect ingestion systems and build scalable data infrastructure.

Skills

ML data pipelines

petabyte-scale datasets

distributed systems

data quality metrics

Job description

Direct message the job poster from HartleyCo

Headhunter | Founding Engineers & Researchers | Partner to YC & Tier 1 VC PortCo | Facilitating Growth

We’re partnering with a next-generation AI company that’s reshaping the future of ML and media - blending deep tech with creative excellence. After a series of strategic acquisitions and partnerships, their growth trajectory is steep, and they’re building a best-in-class technical team to scale even faster.

Right now, Data Engineering is their #1 priority.

They’re actively hiring for:

• Lead / Head of Data Engineering

About the Company:

• Remote-first culture (timezone-flexibility is key)
• Backed by top investors and industry leaders
• Recently acquired a film studio and partnered with a key player in creative AI
• Hardcore belief in combining technical excellence with creative innovation

Why They’re Hiring: Their AI researchers and scientists are stretched thin, pulled into building foundational data pipelines when they should be focused on modeling. They're standing up a dedicated Data Engineering team - and they need top talent now to scale their machine learning efforts, especially around video-based models.

What You'll Work On:

• Own and scale ML training pipelines (think video datasets at petabyte scale)
• Curate datasets from messy, unstructured sources - with a focus on automation
• Architect ingestion systems and build scalable data infrastructure
• Partner deeply with Infra, AI Research, and Product teams
• Play a key role supporting projects like foundational model development and synthetic data generation

Tech Stack & Must-Have Skills:

• Deep experience with ML data pipelines
• Expertise with petabyte-scale datasets, ideally video-heavy
• Knowledge of distributed systems and ML data workflows
• Strong intuition for data quality metrics and ML-native thinking

Bonus Points For:

• Building ML classifiers for data evaluation
• Automated quality control in training pipelines
• Familiarity with AI media and synthetic data tools

What They’re Looking For:

• Systems thinkers who can build and own at scale
• Startup hustle combined with Big Tech polish (Meta, Google, etc.)
• Experience leading roadmaps and building from zero to one
• People who thrive in ambiguity, ownership, and operating without hand-holding

The Process:

• Technical Deep-Dive: 90 minutes with an engineering leader
• Coding Interview: Hands-on session
• Final Chat: With the CEO and/or CSO

They move fast - and will fast-track standout candidates.

Ready to step into a critical role where your work will directly shape the future of AI?

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at HartleyCo by 2x

Get notified about new Data Engineer jobs in London Area, United Kingdom.

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 4 hours ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 months ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 1 week ago

Uxbridge, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 month ago

London Area, United Kingdom £30,000.00-£38,000.00 11 hours ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London Area, United Kingdom £65,000.00-£75,000.00 10 hours ago

Essex, England, United Kingdom 2 weeks ago

London, England, United Kingdom 5 months ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 6 days ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 5 months ago

London, England, United Kingdom 1 month ago

Greater London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 3 months ago

London, England, United Kingdom 5 months ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.