Data Engineer - Pipeline Specialist

Obsidian; Greater London; On-site; GBP 65,000 - 90,000; Full time

Job summary

Mercor is recruiting UK-based Data Engineers for a short, intensive project with a globally leading AI lab. You will produce professional documents and deliverables, working alongside experts from other domains, with outputs used to train frontier AI models.

Ideal candidates are hands-on Data Engineers with strong SQL and Python, ETL/ELT, orchestration, streaming, and warehousing experience across Spark, Kafka, Airflow, dbt, Snowflake, BigQuery or Databricks on AWS, GCP or Azure.

Qualifications

• Hands-on data engineers who build and own pipelines in production.
• Core stack includes SQL and Python; experience with ETL/ELT, orchestration, streaming and data warehousing.
• Familiarity with Spark, Kafka, Airflow, dbt, Snowflake, BigQuery or Databricks on AWS, GCP or Azure.

Responsibilities

• Develop and maintain production data pipelines and data infrastructure.
• Collaborate with domain experts to document and structure work for AI model training.

Job description

Mercor is recruiting UK-Based Data Engineering, experts for a short, intensive project with a globally leading AI lab.

What the work involves

You will produce the kind of professional documents and deliverables you create day to day in your own field, working alongside experts from the other two domains. Those outputs are then logged and used to build the tasks and rubrics that train and evaluate frontier AI models, so your professional judgement is the core of what makes the work valuable.

Who we are looking for

• Data Engineers: hands‑on data engineers who build and own pipelines in production. Titles such as Data Engineer, Senior or Staff Data Engineer, Analytics Engineer, Data Platform Engineer and Data Architect. We are looking for a core stack of SQL and Python, with experience across ETL and ELT, orchestration, streaming and data warehousing, using tools such as Spark, Kafka, Airflow, dbt, Snowflake, BigQuery or Databricks on AWS, GCP or Azure.

Some roles focus on hands‑on delivery, others on documenting and structuring that work.

Commitment

• 40 hours per week, running from 14 September to 10 October 2026

• The project team collaborates on a UK business‑hours rhythm

• You should not be committed to other projects requiring significant hours during this period. Smaller side projects can be discussed.

The vetting process involves

• Resume and work history screen

• A short assessment evaluating domain expertise

Please note:

Candidates must be based in the United Kingdom and have the right to work in the United Kingdom. This is an essential requirement for the role.