Senior Data Engineer — AI Security Data Platform

Refractal; Greater London; On-site; GBP 80,000 - 135,000; Full time

Benefits offered by this job

Salary £80,000–£135,000

Equity sharing

Pension contribution

Private medical and dental

Visa and relocation support

Job summary

Refractal, an AI security company, is seeking an experienced Data Engineer to own production data pipelines and the evidence store used by auditors. You will design the data model, build streaming and batch layers, and ensure data quality and retention controls for regulated customers.

You will collaborate with data scientists and security engineers to prepare training datasets, and support compliance reporting against AI Act, NIST RMF, and ISO standards.

Qualifications

• 6+ years in data engineering, owning production pipelines.
• Strong Python and SQL development for analytics and data products.
• Experience with Postgres and modern data warehouses (BigQuery/ClickHouse).
• Knowledge of streaming systems and orchestration (Kafka, Airflow, Dagster).

Responsibilities

• Design the data model for an append-only, cryptographically signed evidence store.
• Build streaming and batch layers to turn ingested activity into queryable data.
• Own data quality, retention, residency and deletion controls for regulated customers.
• Build training and evaluation datasets with data scientists and security engineers.
• Enable compliance reporting against EU AI Act, NIST AI RMF and ISO/IEC 42001.

Skills

Python

SQL

PostgreSQL

Data warehousing

Streaming data

Data modeling

Airflow

Kafka

Dagster

Security-minded

Tools

BigQuery

ClickHouse

Kafka

Airflow

Dagster

Pub/Sub

Job description

Refractal, an AI security company, is seeking an experienced Data Engineer to own production data pipelines and the evidence store used by auditors. You will design the data model, build streaming and batch layers, and ensure data quality and retention controls for regulated customers.

You will collaborate with data scientists and security engineers to prepare training datasets, and support compliance reporting against AI Act, NIST RMF, and ISO standards.