Lead DevOps Engineer (Data)

With Intelligence; London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading data services company in London is seeking a Senior DevOps Engineer to own and manage the data platform infrastructure built on AWS. You will ensure platform reliability and enhance CI/CD processes while promoting DevOps practices. The ideal candidate has strong AWS knowledge, experience with Snowflake, and automation skills. This role offers excellent benefits including flexible working arrangements.

Benefits

24 days annual leave, rising to 29

Enhanced parental leave

Wellness Days

Flexible Fridays

Birthday day off

Employee assistance program

Charity days

Breakfast and social events

Qualifications

• Experience owning and operating production data platforms on AWS.
• Proficiency with CI/CD pipelines, especially Bitbucket Pipelines.
• Ability to work through ambiguity and in collaborative teams.

Responsibilities

• Manage data platform infrastructure on AWS.
• Ensure platform reliability and scalability.
• Enhance CI/CD processes using Bitbucket pipelines.

Skills

AWS services knowledge

CI/CD pipelines

Infrastructure as Code tools

Python scripting

Snowflake administration

Collaboration skills

Ambiguity navigation

Tools

Bitbucket

Terraform

CloudFormation

Job description

We are seeking a Senior DevOps Engineer to take full ownership of our data platform infrastructure. You’ll play a key role in scaling and supporting our data systems, which leverage a modern AWS stack and Snowflake. This is a high-impact role with direct influence over reliability, observability, and the DevOps maturity of our data engineering function.

Key Responsibilities

1. Platform Ownership
2. Own and manage the data platform infrastructure built on AWS services (EventBridge, Lambda, EC2, MWAA, S3).
3. Oversee deployment and monitoring of Snowflake, and support its integration into the broader data ecosystem.
4. Infrastructure and System Reliability
5. Ensure platform reliability, availability, and scalability across environments.
6. Design and maintain robust monitoring, alerting, and observability frameworks to reduce MTTR and improve visibility.
7. Lead initiatives related to data lineage, platform health, and alert hygiene.
8. CI/CD and Automation
9. Enhance our CI/CD processes using Bitbucket pipelines.
10. Drive DevOps practices across data engineering teams.
11. Implement infrastructure as code using tools like Terraform or CloudFormation.
12. Collaborate with data engineering teams to identify and improve platform pain points.
13. Security & Networking
14. Manage VPCs, security groups, IAM roles, and cross-account networking within AWS.
15. Support secure integration with third-party services like Microsoft PowerApps.

Requirements

• Experience owning and operating production data platforms on AWS.
• Strong knowledge of AWS services: EventBridge, Lambda, EC2, S3, MWAA.
• Experience with platform reliability, observability, and automation tools.
• Proficiency with CI/CD pipelines, especially Bitbucket Pipelines.
• Knowledge of Snowflake administration and deployment.
• Ability to work through ambiguity and in collaborative teams.
• Experience with infrastructure-as-code tools such as Terraform or CloudFormation.
• Python scripting skills for automation.
• Exposure to MLOps workflows.
• Familiarity with Power Platform, especially PowerApps, in data contexts.
• Understanding of data lineage, governance, and operational monitoring.

Benefits

• 24 days annual leave, rising to 29
• Enhanced parental leave
• Wellness Days
• Flexible Fridays
• Birthday day off
• Employee assistance program
• Charity days
• Breakfast and social events
• Hybrid working model

About Our Company

With Intelligence, based in London, offers excellent benefits, including free breakfast, drinks, and social activities. We foster a vibrant, social work environment and serve senior asset management industry clients with leading editorial, research, and data services. We are committed to diversity and equal opportunity in our hiring practices.