Senior DataOps Engineer: Reliable Data Platform & CI/CD

Valarian Technologies; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Equity

Competitive salary

Employer pension contributions

Private health insurance

Hybrid work setup

Gym memberships

Team retreats

Job summary

Valarian Technologies is building frontier AI infrastructure with a focus on secure, production-grade data services. We seek engineers to own data pipelines, observability, and resilient workloads across on-prem and cloud environments.

You will collaborate with data and platform engineers to deploy robust, auditable processing in regulated enterprise settings, with a London-hub oriented hybrid work model.

Qualifications

• Demonstrable experience operating production data pipelines or data platforms with ownership of reliability and incident resolution.
• Strong practical Kubernetes, container and Linux skills, including troubleshooting workloads, networking, resource limits and persistent storage.
• Experience building automated delivery workflows using Git, CI/CD and declarative configuration; familiarity with Helm, GitOps or equivalent approaches.

Responsibilities

• Build and maintain CI/CD and GitOps workflows for data applications, pipelines, configuration and database changes, including validation, promotion and rollback.
• Develop reusable tooling for scheduling, dependency management, retries, checkpoints, replay and backfills.
• Establish monitoring and actionable alerts for pipeline freshness, completeness, processing latency, failures and resource usage.
• Operate workload-owned data services and coordinate with ACRA platform owners for shared database, messaging and storage services.
• Implement and exercise recovery procedures, including backup restoration, interrupted processing and failed upgrades.
• Integrate data workloads with ACRA's identity, secrets and network controls, preserving enclave isolation and authorised access.
• Investigate production incidents, improve runbooks and automate recurring operational work.

Skills

Kubernetes

Linux

GitOps

Python

SQL

Airflow

Helm

Tools

OpenShift

Terraform

Prometheus

Grafana

PostgreSQL

Dagster

OpenTelemetry

Job description

Valarian Technologies is building frontier AI infrastructure with a focus on secure, production-grade data services. We seek engineers to own data pipelines, observability, and resilient workloads across on-prem and cloud environments.

You will collaborate with data and platform engineers to deploy robust, auditable processing in regulated enterprise settings, with a London-hub oriented hybrid work model.