AI Training Data Engineer - Production Pipelines (UK)

Obsidian; Greater London; On-site; GBP 92,000 - 148,000; Full time

Job summary

Mercor is recruiting UK-based Data Engineering experts for a short, intensive project with a globally leading AI lab. You will build and own production data pipelines using SQL and Python, with orchestration tools like Airflow and streaming frameworks such as Spark/Kafka.

The role involves collaboration across teams and potential documentation tasks to structure work for frontier AI model training. The project runs 40 hours per week from 14 September to 10 October 2026, with UK business-hour

Qualifications

• Hands-on data engineers who build and own pipelines in production.
• Core stack includes SQL and Python with ETL/ELT, orchestration, streaming and data warehousing.
• Experience with Spark, Kafka, Airflow, dbt, Snowflake, BigQuery or Databricks on AWS, GCP or Azure.
• Roles vary between hands-on delivery and documenting/structuring work.

Responsibilities

• Build and own production data pipelines.
• Collaborate with domain experts to shape data tasks.
• Document and structure work for downstream models training.

Skills

SQL

Python

ETL/ELT

Airflow

Spark

Kafka

dbt

Snowflake

BigQuery

Databricks

AWS

GCP

Azure

Tools

Spark

Kafka

Airflow

dbt

Snowflake

BigQuery

Databricks

Job description

Mercor is recruiting UK-based Data Engineering experts for a short, intensive project with a globally leading AI lab. You will build and own production data pipelines using SQL and Python, with orchestration tools like Airflow and streaming frameworks such as Spark/Kafka.

The role involves collaboration across teams and potential documentation tasks to structure work for frontier AI model training. The project runs 40 hours per week from 14 September to 10 October 2026, with UK business-hour