DevOps Engineer

Vallum Associates; Greater London; On-site; GBP 65,000 - 95,000; Full time

Job summary

Vallum Associates seeks a DevOps Engineer to design and implement a global marketing data platform. You will consolidate client profiles and marketing preferences into a master data repository, managing pipelines from diverse sources and distributing data via APIs and bulk feeds.

The role requires strong IaC and CI/CD automation, cloud-native and big data experience, plus hands-on Terraform, scripting, and Azure DevOps expertise. Excellent communication of complex solutions is essential.

Qualifications

• Proven DevOps expertise in cloud environments with IaC and CI/CD pipelines.
• Hands-on Terraform and scripting (Shell or PowerShell) experience.
• GitLab integration across build and release cycles.
• Azure Cloud exposure, including Azure DevOps and Vault.
• Experience with Spark and Cloudera stacks (Hue, Hive, HDFS).
• Strong problem-solving and ability to communicate technical solutions.
• Background on data-driven projects and master data management.

Responsibilities

• Design and implement a global marketing data platform integrating client profiles and preferences.
• Build and operate data pipelines from multiple sources and deliver via APIs and bulk feeds.
• Leverage IaC, CI/CD, and cloud-native Big Data ecosystems to enable scalable platforms.
• Collaborate with data engineering teams to ensure data quality and governance.

Skills

Cloud environments & IaC

Terraform

Scripting (Shell/PowerShell)

GitLab

Azure Cloud & Vault

Big data / Spark / Cloudera

Communication skills

Master data management

Tools

GitLab

Azure DevOps

Databricks

AKS

HDFS / Hive / Hue

Job description

We're looking for a DevOps Engineer for one of our prestigious client You will play a key role in designing and implementing the global marketing data platform that consolidates client profiles and marketing preferences into a centralized master repository.

This system will manage data pipelines from multiple sources, handle master data management elements, and distribute data via APIs and bulk feeds to marketing platforms. The role requires expertise in Infrastructure as Code (IaC), CI/CD automation, and experience in cloud-native and big data ecosystems.

Requirements (Must Have Skills)

• Proven DevOps expertise in cloud environments, including IaC and CI/CD pipeline management
• Strong hands-on skills in Terraform and Scripting (Shell or PowerShell)
• Experience working with GitLab and integrating automation into build and release cycles
• Exposure to Azure Cloud and PaaS services, including Azure DevOps and Vault
• Familiarity with data engineering and big data ecosystems, including Spark and Cloudera stacks (hue, hive, HDFS)
• Excellent problem-solving skills and ability to communicate technical solutions effectively
• Previous experience working on data-driven projects and master data management solutions

Nice to Have Skills

• Hands-on experience with Azure Data Factory and Databricks for advanced data processing
• Knowledge of AKS (Azure Kubernetes Services) for containerized workloads
• Knowledge of customer data platforms, personalization strategies, and data governance requirements