Data & Reporting SRE

ZILO; London; Hybrid; GBP 60,000 - 85,000; Full time

Job summary

ZILO is looking for an experienced Site Reliability Engineer (SRE) in London to ensure the reliability and performance of data pipelines. This role involves managing incidents, designing observability tools, and collaborating across teams to optimize data systems. Join a progressive company and help shape the future of technology while enjoying an extensive benefits package including enhanced leave and flexible working arrangements.

Benefits

Enhanced leave - 38 days inclusive of 8 UK Public Holidays

Private Health Care including family cover

Life Assurance – 5x salary

Flexible working - work from home or in our London Office

Employee Assistance Program

Company Pension (Salary Sacrifice options available)

Access to training and development

Buy and Sell holiday scheme

Global mobility opportunities

Qualifications

• Deep expertise in data processing and reporting.
• Experience with AWS services and data pipelines.
• Ability to troubleshoot complex data-related incidents.

Responsibilities

• Own reliability and operational excellence of data pipelines.
• Serve as on-call escalation for data pipeline incidents.
• Design, implement, and maintain observability for data pipelines.

Skills

AWS

Kafka

Apache Flink

Python

Data Analysis

Observability

Incident Management

Education

Relevant Bachelor's degree or equivalent experience

Job description

About:

Step forward into the future of technology with ZILO.

We’re here to redefine what’s possible in technology. While we’re trusted by the global Transfer Agency sector, our technology is truly flexible and designed to transform any business at scale. We’ve created a unified platform that adapts to diverse needs, offering the scalability and reliability legacy systems simply can’t match.

At ZILO, our DNA is built on Character, Creativity, and Craftsmanship. We face every challenge with integrity, explore new ideas with a curious mind, and set a high standard in every detail.

We are a team of dedicated professionals where everyone, regardless of their role, drives our progress and creates real impact. If you’re ready to shape the future, let’s talk.

We are seeking an experienced Site Reliability Engineer (SRE) with deep subject-matter expertise in data processing and reporting. In this role, you will own the reliability, performance, and operational excellence of our real-time and batch data pipelines built on AWS, Apache Flink, Kafka, and Python. You’ll act as the first line of defense for data-related incidents, rapidly diagnose root causes, and implement resilient solutions that keep critical reporting systems up and running.

Incident Management & Triage

• Serve as on-call escalation for data pipeline incidents, including real-time stream failures and batch job errors.
• Rapidly analyze logs, metrics, and trace data to pinpoint failure points across AWS, Flink, Kafka, and Python layers.
• Lead post-incident reviews: identify root causes, document findings, and drive corrective actions to closure.

Reliability & Monitoring

• Design, implement, and maintain robust observability for data pipelines: dashboards, alerts, distributed tracing.
• Define SLOs/SLIs for data freshness, throughput, and error rates; continuously monitor and optimize.
• Automate capacity planning, scaling policies, and disaster-recovery drills for stream and batch environments.

Architecture & Automation

• Collaborate with data engineering and product teams to architect scalable, fault-tolerant pipelines using AWS services (e.g., Step Functions, EMR, Lambda, Redshift) integrated with Apache Flink and Kafka.
• Troubleshoot & Maintain Python-based applications.
• Harden CI/CD for data jobs: implement automated testing of data schemas, versioned Flink jobs, and migration scripts.

Performance Optimization

• Profile and tune streaming jobs: optimize checkpoint intervals, state backends, and parallelism settings in Flink.
• Analyze Kafka cluster health: tune broker configurations, partition strategies, and retention policies to meet SLAs.
• Leverage Python profiling and vectorized libraries to streamline batch analytics and report generation.

Collaboration & Knowledge Sharing

• Act as SME for data & reporting stack: mentor peers, lead brown-bag sessions on best practices.
• Contribute to runbooks, design docs, and on-call playbooks detailing common failure modes and recovery steps.
• Work cross-functionally with DevOps, Security, and Product teams to align reliability goals and incident response workflows.

• Enhanced leave - 38 days inclusive of 8 UK Public Holidays
• Private Health Care including family cover
• Life Assurance – 5x salary
• Flexible working-work from home and/or in our London Office
• Employee Assistance Program
• Company Pension(Salary Sacrifice options available)
• Access to training and development
• Buy and Sell holiday scheme
• The opportunity for “work from anywhere/global mobility”