Senior Platform Engineer - Azure Data & AI Platform

Howden UK Brokers

Greater London

On-site

GBP 90,000 - 140,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Howden UK Brokers is seeking a Senior Platform Engineer to build and operate an Azure-based data and AI platform. You’ll work hands-on with Terraform and Azure networking, defining landing zones and hub-spoke topologies while embedding DevSecOps practices.

You’ll drive Databricks deployments, Unity Catalog governance, CI/CD for notebooks, and ML deployment pipelines using Azure ML or MLflow. A security-first mindset and strong scripting skills are essential.

Qualifications

  • 5+ years of platform/infrastructure engineering experience.
  • Deep Azure knowledge including networking, IAM, storage, compute.
  • Databricks: Unity Catalog, optimized Spark jobs, cost management.
  • IaC with Terraform or Bicep; modular design and scale.
  • CI/CD pipelines with Azure DevOps or GitHub Actions with security gates.
  • Containerization best practices for apps and ML/AI models.
  • Security-first mindset: least privilege, network segmentation.
  • MLOps fundamentals: training vs inference, experiment tracking.
  • Python and/or PowerShell for automation.
  • Observability stack: tracing, log aggregation.

Responsibilities

  • Design Azure landing zones, management groups, and subscription architecture.
  • Build hub-spoke networks with secure controls.
  • Implement Azure Policy, RBAC, governance and cost controls.
  • Manage identities with Entra ID and service principals.
  • Set up monitoring with Azure Monitor, Log Analytics, Application Insights.
  • Deploy Databricks workspaces with Unity Catalog and data governance.
  • Enable CI/CD for Databricks notebooks, jobs, and infra.
  • Develop ML deployment pipelines using Azure ML or Databricks MLflow.
  • Create self-service tooling and platform docs; participate in on-call rotation.

Skills

Cloud infrastructure
Azure networking
IAM & security
Data platform experience
CI/CD enablement
Security mindset
Python/PowerShell
Observability

Tools

Terraform
Bicep
Azure DevOps
GitHub Actions
Databricks
Unity Catalog
Azure Monitor
Log Analytics
Application Insights
ADLS Gen2
Azure SQL
Synapse

Job description

Who are we?

Howden is a global insurance group with employee ownership at its heart. Together, we have pushed the boundaries of insurance. We are united by a shared passion and no-limits mindset, and our strength lies in our ability to collaborate as a powerful international team comprised of 24,000 employees spanning over 56 countries.

People join Howden for many different reasons, but they stay for the same one: our culture. It's what sets us apart, and the reason our employees have been turning down headhunters for years. Whatever your priorities - work / life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden.

Senior Platform Engineer - Azure Data & AI Platform
The Role

We are looking for senior platform engineers to build and operate our Azure-based data and AI platform. This is hands-on infrastructure and platform work - you'll be writing Terraform, designing network architecture, implementing MLOps (AI model ) pipelines, and establishing DevSecOps patterns that engineering teams can use .

This isn't a "thought leadership" or "strategy" role. You'll be in the code, in the CLI, and in the infrastructure daily.

What You'll Actually Do
Azure Platform Engineering (40%)
  • Design and implement Azure landing zones, management groups, and subscription architecture
  • Build and maintain hub-spoke network topologies with proper segmentation and security controls
  • Implement Azure Policy, RBAC, and governance frameworks that balance security with developer productivity
  • Manage identity and access using Entra ID, service principals, managed identities
  • Establish monitoring, logging, and alerting with Azure Monitor, Log Analytics, and Application Insights
  • Cost management and FinOps practices - keeping cloud spend under control without hamstringing teams
Databricks & Data Platform (30%)
  • Deploy and configure Azure Databricks workspaces with Unity Catalog for data governance
  • Assisting both data and AI teams with pipeline development
  • Establish Databricks best practices: cluster policies, job scheduling, notebook standards, workspace organization
  • Integrate Databricks with ADLS Gen2, Azure SQL, Synapse, and other data services
  • Set up and maintain CI/CD for Databricks notebooks, jobs, and infrastructure
  • Work with data engineers on performance optimization, cost control, and platform capabilities
MLOps & AI Platform (20%)
  • Build ML model deployment pipelines using Azure ML, Databricks MLflow, or both
  • Implement model versioning, experiment tracking, and model registry patterns
  • Establish inference endpoints (batch and real-time) with proper monitoring and governance
  • Create reusable ML pipeline templates and infrastructure-as-code modules
  • Integrate AI services (Azure OpenAI, Cognitive Services) into platform offerings
  • Implement responsible AI guardrails: model monitoring, bias detection, explainability
DevSecOps & Platform Enablement (10%)
  • Creation of tools, features and dashboards for the developer platform
  • Build CI/CD pipelines in Azure DevOps or GitHub Actions with proper security scanning
  • Implement shift- left security: SAST/DAST, dependency scanning, infrastructure scanning, secrets management
  • Establish infrastructure-as-code standards with Terraform (or Bicep), including modules and policy enforcement
  • Create self-service tooling and automation for common platform tasks
  • Write documentation that engineers will read and use
  • Participate in on-call rotation for platform incidents
What We Need From You
Required
  • 5+ years platform/infrastructure engineering - you've built production platforms, not just prototypes
  • Deep Azure knowledge - networking, IAM, storage, compute, PaaS services. You know the difference between service endpoints and private endpoints and when to use each
  • Databricks experience - you've deployed workspaces, configured Unity Catalog, optimized Spark jobs, managed costs
  • Infrastructure as Code - Terraform (preferred) or Bicep. You write modules, understand state management, know how to structure large IaC projects
  • CI/CD pipelines - Azure DevOps or GitHub Actions. You've built multi-stage pipelines with gates, approvals, and security scanning
  • Containerization experience - you know best practices when building and working with both application-based containers and containers holding ML/ AI models
  • Security-first mindset - you understand defense in depth, least privilege, network segmentation, and don't treat security as an afterthought
  • MLOps fundamentals - model training vs inference, experiment tracking, model versioning, deployment patterns
  • Python and/or PowerShell - for automation, tooling, and platform utilities
  • O bservability stack beyond basic metrics (distributed tracing, log aggregation patterns)
Strongly Preferred
  • Experience with Azure landing zones and CAF (Cloud Adoption Framework)
  • Microsoft Purview for data governance and cataloging
  • Experience with Delta Lake, Spark optimization, data quality fra
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineer
Platform Engineer

London Stock Exchange • Greater London

On-site
GBP 75,000 - 110,000
Senior Data Engineer - Azure Databricks Platform
Senior Data Engineer - Azure Databricks Platform

EnerMech • United Kingdom

Remote
GBP 80,000 - 120,000
Senior Platform Engineer - Azure Data & AI Platform
Senior Platform Engineer - Azure Data & AI Platform

Howden • Greater London

Remote
GBP 90,000 - 140,000
Remote-first with occasional in-office
Learning budget and tooling support
Hybrid/office travel for workshops
Senior Azure Data & AI Platform Engineer - Remote
Senior Azure Data & AI Platform Engineer - Remote

Howden Group Holdings • Greater London

Hybrid
GBP 110,000 - 150,000
Remote-first
Learning budget
Equipment & licenses
+1
Senior Platform Engineer - Azure Data & Ai Platform
Senior Platform Engineer - Azure Data & Ai Platform

Howden Group Holdings • Greater London

Hybrid
GBP 110,000 - 150,000
Remote-first
Learning budget
Equipment & licenses
+1
Cloud Engineering Lead (Azure)
Cloud Engineering Lead (Azure)

TXP • City Of London

Hybrid
GBP 111,000 - 115,000
DevOps Engineer
DevOps Engineer

Eden Smith Group • Worthing

Hybrid
GBP 60,000 - 90,000
Annual bonus
Competitive pension
28 days annual leave + bank holidays
+1
Senior Azure Data & AI Platform Engineer
Senior Azure Data & AI Platform Engineer

Howden Group Holdings • City Of London

Remote
GBP 90,000 - 130,000
Remote-first
Learning budget
Equipment provided
+1
Senior DevOps / Platform Engineer
Senior DevOps / Platform Engineer

IntelStack • United Kingdom

Hybrid
GBP 85,000 - 110,000
DevOps Engineer
DevOps Engineer

Element Materials Technology • United Kingdom

On-site
GBP 60,000 - 80,000