DevOps Engineer (Bank/FS)

Vallum Associates; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Vallum Associates in London is seeking an experienced DevOps Engineer to design, implement and support scalable cloud infrastructure and CI/CD pipelines for a modern Azure-based data platform.

You will collaborate with engineering, architecture and data teams to automate deployments, improve reliability and support high-volume data processing environments. Strong Azure, IaC and DevOps automation experience is essential.

Qualifications

• Experience with Azure cloud environments.
• Proficiency with Terraform and IaC.
• Experience building CI/CD pipelines (GitLab, Azure DevOps, Jenkins or similar).
• Scripting knowledge using Shell, Bash or PowerShell.
• Experience with Azure services and data platforms.
• Strong troubleshooting and collaboration skills.

Responsibilities

• Design, develop, and maintain automated CI/CD pipelines.
• Build and manage cloud infrastructure using Terraform and IaC best practices.
• Deploy, configure, and support Azure cloud services and PaaS components.
• Collaborate with architects and development teams on scalable cloud-native solutions.
• Support big data platforms and data processing technologies.
• Automate environment provisioning, deployments, monitoring and config management.
• Troubleshoot deployment, infra, and performance issues across environments.
• Implement security, governance, and operational best practices.
• Support ETL workflows and data integrations.
• Continuously improve DevOps processes and release automation.

Tools

Azure

Terraform

CI/CD pipelines

Shell/Bash/PowerShell

Azure DevOps

Key Vault

Databricks

Spark

HDFS

AKS

Job description

We are seeking an experienced DevOps Engineer to join our growing technology team in London. The successful candidate will be responsible for designing, implementing, and supporting scalable cloud infrastructure and CI/CD pipelines for a modern Azure-based data platform. This role involves working closely with engineering, architecture, and data teams to automate deployments, improve platform reliability, and support high-volume data processing environments. The ideal candidate will have strong experience with Azure, Infrastructure as Code, DevOps automation, and big data technologies.

Key Responsibilities

• Design, develop, and maintain automated CI/CD pipelines using GitLab, Azure DevOps, Jenkins, or similar tools.
• Build and manage cloud infrastructure using Terraform and Infrastructure as Code (IaC) best practices.
• Deploy, configure, and support Azure cloud services and PaaS components to ensure secure and reliable environments.
• Collaborate with solution architects and development teams to implement scalable, cloud-native solutions.
• Support big data platforms and data processing technologies, including Spark, Databricks, Cloudera, Hive, and HDFS.
• Automate environment provisioning, application deployments, monitoring and configuration management.
• Troubleshoot deployment, infrastructure, and performance issues across development, testing, and production environments.
• Implement security, governance, and operational best practices while ensuring platform availability and performance.
• Work closely with data engineering teams to support ETL workflows, master data management, and API-based integrations.
• Continuously improve DevOps processes, release management, and deployment automation across the organization.

Required Skills & Experience

• Proven experience as a DevOps Engineer working with Azure cloud environments.
• Strong hands-on expertise with Terraform and Infrastructure as Code.
• Experience building and maintaining CI/CD pipelines using GitLab, Azure DevOps, Jenkins, or TeamCity.
• Good scripting knowledge using Shell, Bash, or PowerShell.
• Experience with Azure services, including Azure DevOps, Key Vault, and other PaaS offerings.
• Knowledge of big data technologies such as Spark, Databricks, Cloudera, Hive, and HDFS.
• Experience supporting data platforms, ETL processes, and cloud-based data pipelines.
• Strong troubleshooting, analytical, and problem-solving skills.
• Excellent communication skills with the ability to collaborate across technical and business teams.

Preferred Skills

• Experience with Azure Data Factory and Databricks.
• Knowledge of Azure Kubernetes Service (AKS) and containerization technologies.
• Familiarity with customer data platforms, data governance, and master data management.
• Experience working in Agile/Scrum environments and using DevOps best practices for continuous delivery.