Senior DataOps Engineer: Platform Reliability

Valarian; Greater London; Hybrid; GBP 85,000 - 125,000; Full time

Benefits offered by this job

Equity

Competitive salary

Employer pension contributions

Private health insurance

Hybrid work setup

Gym memberships

Company retreats

Job summary

Valarian, a London-based frontier AI infrastructure company, is seeking a data platform engineer to make data services reproducible, observable, and safe to recover. You will collaborate with data engineers and platform engineers across customer-controlled environments to ensure reliable production workloads.

You will build and maintain CI/CD workflows, develop reusable tooling, and establish monitoring and recovery procedures to sustain high-availability data processing in secure environments.

Qualifications

• Proven experience operating production data pipelines or data platforms with ownership of reliability.
• Strong practical Kubernetes, container and Linux skills, incl. troubleshooting workloads.
• Experience building automated delivery workflows using Git, CI/CD and declarative configuration (Helm/GitOps).
• Python and shell scripting for automation, plus SQL for data issues.

Responsibilities

• Build and maintain CI/CD and GitOps workflows for data applications and pipelines, including validation, promotion and rollback.
• Develop reusable tooling for scheduling, dependency management, retries, checkpoints, replay and backfills.
• Establish monitoring and actionable alerts for pipeline freshness, completeness, latency, failures, and resources.
• Operate workload-owned data services and coordinate with platform owners for shared services.
• Implement recovery procedures including backup restoration and handling failed upgrades.
• Integrate data workloads with identity, secrets and network controls, preserving enclave isolation.

Skills

Kubernetes

Containerization

Linux

GitOps

CI/CD

Python

SQL

Airflow

Observability

Incident response

Tools

Helm

OpenShift

ArgoCD

Terraform

Prometheus

Grafana

OpenTelemetry

Job description

Valarian, a London-based frontier AI infrastructure company, is seeking a data platform engineer to make data services reproducible, observable, and safe to recover. You will collaborate with data engineers and platform engineers across customer-controlled environments to ensure reliable production workloads.

You will build and maintain CI/CD workflows, develop reusable tooling, and establish monitoring and recovery procedures to sustain high-availability data processing in secure environments.