Data & Reporting SRE

ZILO; City Of London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A forward-thinking technology company in London is looking for an experienced Site Reliability Engineer (SRE) to oversee the reliability and performance of data processing pipelines. The ideal candidate will manage incidents, design observability metrics, and collaborate on architecture solutions using AWS services. This position offers flexible working arrangements and a comprehensive benefits package including enhanced leave and private healthcare.

Benefits

Enhanced leave - 38 days

Private Health Care

Life Assurance – 5x salary

Flexible working

Employee Assistance Program

Company Pension

Access to training and development

Buy and Sell holiday scheme

Global mobility option

Qualifications

• Deep subject-matter expertise in data processing and reporting.
• Experience maintaining real-time and batch data pipelines.
• Ability to rapidly diagnose and solve data-related incidents.

Responsibilities

• Serve as on-call escalation for data pipeline incidents.
• Design and maintain observability for data pipelines.
• Collaborate with teams to architect scalable data solutions.

Skills

Data processing expertise

AWS proficiency

Kafka knowledge

Python programming

Incident management

Tools

Apache Flink

AWS Step Functions

AWS EMR

AWS Lambda

AWS Redshift

Job description

Overview

About:

Step forward into the future of technology with ZILO.

We’re here to redefine what’s possible in technology. While we’re trusted by the global Transfer Agency sector, our technology is truly flexible and designed to transform any business at scale. We’ve created a unified platform that adapts to diverse needs, offering the scalability and reliability legacy systems simply can’t match.

At ZILO, our DNA is built on Character, Creativity, and Craftsmanship. We face every challenge with integrity, explore new ideas with a curious mind, and set a high standard in every detail.

We are a team of dedicated professionals where everyone, regardless of their role, drives our progress and creates real impact. If you’re ready to shape the future, let’s talk.

We are seeking an experienced Site Reliability Engineer (SRE) with deep subject-matter expertise in data processing and reporting. In this role, you will own the reliability, performance, and operational excellence of our real-time and batch data pipelines built on AWS, Apache Flink, Kafka, and Python. You’ll act as the first line of defense for data-related incidents, rapidly diagnose root causes, and implement resilient solutions that keep critical reporting systems up and running.

Responsibilities

• Incident Management & Triage
  • Serve as on-call escalation for data pipeline incidents, including real-time stream failures and batch job errors.
  • Rapidly analyze logs, metrics, and trace data to pinpoint failure points across AWS, Flink, Kafka, and Python layers.
  • Lead post-incident reviews: identify root causes, document findings, and drive corrective actions to closure.

• Reliability & Monitoring
  • Design, implement, and maintain robust observability for data pipelines: dashboards, alerts, distributed tracing.
  • Define SLOs/SLIs for data freshness, throughput, and error rates; continuously monitor and optimize.
  • Automate capacity planning, scaling policies, and disaster-recovery drills for stream and batch environments.

• Architecture & Automation
  • Collaborate with data engineering and product teams to architect scalable, fault-tolerant pipelines using AWS services (e.g., Step Functions, EMR, Lambda, Redshift) integrated with Apache Flink and Kafka.
  • Troubleshoot & Maintain Python-based applications.
  • Harden CI/CD for data jobs: implement automated testing of data schemas, versioned Flink jobs, and migration scripts.

• Performance Optimization
  • Profile and tune streaming jobs: optimize checkpoint intervals, state backends, and parallelism settings in Flink.
  • Analyze Kafka cluster health: tune broker configurations, partition strategies, and retention policies to meet SLAs.
  • Leverage Python profiling and vectorized libraries to streamline batch analytics and report generation.

• Collaboration & Knowledge Sharing
  • Act as SME for data & reporting stack: mentor peers, lead brown-bag sessions on best practices.
  • Contribute to runbooks, design docs, and on-call playbooks detailing common failure modes and recovery steps.
  • Work cross-functionally with DevOps, Security, and Product teams to align reliability goals and incident response workflows.

Benefits

• Enhanced leave - 38 days inclusive of 8 UK Public Holidays
• Private Health Care including family cover
• Life Assurance – 5x salary
• Flexible working-work from home and/or in our London Office
• Employee Assistance Program
• Company Pension(Salary Sacrifice options available)
• Access to training and development
• Buy and Sell holiday scheme
• The opportunity for “work from anywhere/global mobility”