Data Engineer: Secure Data Pipelines for ML & Quantum

OQC; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

OQC is shaping the next era of quantum computing with a focus on secure data foundations for ML and quantum workloads. Based in London, the Data Engineer will own ingestion, transformation and governance across cloud, on-premise and datacentre environments.

You will work with Databricks, Spark and Delta Lake to deliver reliable, traceable datasets and enable customer-facing applications while maintaining strict data security and lineage across teams.

Qualifications

• Design, build and operate governed data pipelines across multiple sources.
• Experience with cloud, on-premise or hybrid data environments.
• Strong understanding of data quality, lineage and access controls.
• Knowledge of ML data needs and synthetic data concepts is a plus.
• Experience securing data in transit and at rest with audit logging.
• Ability to communicate across Software, Platform, Security and ML teams.

Responsibilities

• Design, build and operate secure data ingestion and transformation pipelines across internal, external and customer data sources.
• Build data workflows spanning cloud, private-cloud, on-premise and datacentre environments.
• Develop governed datasets for machine learning and quantum workloads, defining data contracts, versions, quality rules, entitlements, lineage and retention.
• Create robust training, validation, calibration and untouched test datasets that enable credible ML evaluation.
• Transform raw customer data into QPU-permitted features or latent representations and return outputs into governed synthetic datasets.
• Monitor and optimise pipeline reliability, throughput, latency, storage utilisation and operational cost.
• Build automated testing and CI/CD practices for data pipelines and infrastructure, partnering across engineering teams to deliver reliable data foundations for customer-facing products.

Skills

Data pipeline design

Data governance

Security and access controls

Cross-team collaboration

Education

Bachelor's or MSc in Computer Science or related field

Tools

Databricks

Spark

Delta Lake

SQL

Job description

OQC is shaping the next era of quantum computing with a focus on secure data foundations for ML and quantum workloads. Based in London, the Data Engineer will own ingestion, transformation and governance across cloud, on-premise and datacentre environments.

You will work with Databricks, Spark and Delta Lake to deliver reliable, traceable datasets and enable customer-facing applications while maintaining strict data security and lineage across teams.