AI Platform Architect

idpp; Greater London; Hybrid; GBP 110,000 - 150,000; Full time

Benefits offered by this job

Annual bonus

Pension up to 11%

Hybrid working

25 days leave

Buy/sell leave

Health & wellbeing

Career development

Inclusive culture

Share options

Job summary

idpp is seeking an experienced AI Platform Architect to define and evolve an enterprise-grade AI platform spanning Microsoft Azure and AWS. You will own the platform's architectural vision and roadmap, guiding teams from experimentation through secure production deployment.

The role emphasizes GenAI hosting, MLOps, security and governance, with hybrid working and collaboration across engineering, security, data, and business stakeholders.

Qualifications

• Experience designing enterprise-scale AI/ML platforms across multi-clouds.
• Deep knowledge of training pipelines, orchestration, observability and MLOps.
• Generative AI architecture with LLMs, RAG, vector stores, prompt orchestration.
• Strong multi-cloud, networking, IAM, security and cross-cloud integration.
• Experience with ML tools such as MLflow, Kubeflow, SageMaker, Azure ML, Databricks.
• Knowledge of Responsible AI, data protection and governance incl. GDPR.
• Architecture modelling and technical documentation proficiency.
• Ability to design scalable cost-efficient AI training/inference architectures.
• Leadership experience guiding engineering teams on platform problems.
• Experience in regulated environments (finance/insurance) is advantageous.

Responsibilities

• Own end-to-end architecture of a multi-cloud AI platform across Azure and AWS.
• Define platform capabilities for ML pipelines, feature stores, model hosting, observability, MLOps/AIOps, GenAI orchestration, vector search, RAG and agents.
• Develop scalable GenAI architectures including LLM hosting, fine-tuning and prompt orchestration.
• Evaluate cloud-native, open-source and third-party AI technologies and recommend tooling.
• Design secure integration patterns between cloud platforms and enterprise systems.
• Provide architectural direction to ensure security, governance and scalability.
• Produce architecture blueprints, reference architectures, capability models and runbooks.
• Oversee implementation to align with architectural principles.
• Embed Responsible AI, privacy and regulatory requirements into platform design.
• Drive cost optimisation for compute, storage and AI inference while maintaining resilience.
• Represent AI platform in governance forums; collaborate with data scientists, ML engineers and business stakeholders.
• Provide technical guidance and mentorship to engineering teams.

Skills

AI Platform design

Azure & AWS

Generative AI

Multi-cloud architecture

Technical leadership

Tools

MLflow

Kubeflow

SageMaker

Azure Machine Learning

Databricks

Vector databases

Inference frameworks

Job description

Working Pattern: Hybrid – 3 days per week in the office

Salary: We would like to hear your salary expectations when we discuss your application with you over the phone. The benefits package is listed below.

The Opportunity

We are looking for an experienced AI Platform Architect to define, design and evolve an enterprise-grade AI platform spanning Microsoft Azure and AWS.

This is a senior architectural role with ownership of the platform's overall technical vision, architecture and roadmap. You will shape a scalable, secure and cost-effective environment supporting traditional machine learning, model training and hosting, Generative AI, advanced AI capabilities and emerging technologies.

Working closely with engineering, security, data, enterprise architecture and business teams, you will establish the architectural standards and capabilities that enable AI/ML teams to take solutions from experimentation through to secure, production-ready deployment.

What You'll Be Doing

• Own the end-to-end architecture of a multi-cloud AI platform across Azure and AWS.
• Define platform capabilities covering ML training pipelines, feature stores, model hosting, observability, MLOps/AIOps, GenAI orchestration, vector search, RAG and agent frameworks.
• Develop scalable architectures for Generative AI, including LLM hosting, fine-tuning, prompt orchestration, evaluation, content filtering and AI safety controls.
• Evaluate cloud-native, open-source and third-party AI technologies and make evidence-based tooling recommendations.
• Design secure integration patterns between Azure, AWS and internal enterprise systems.
• Provide architectural direction for AI solutions, ensuring they make effective use of platform capabilities and meet security, governance and scalability requirements.
• Produce high-quality architecture blueprints, reference architectures, capability models, C4 diagrams, standards, decision records and runbooks.
• Oversee implementation to ensure platform components are delivered in line with agreed architectural principles.
• Embed security, privacy, regulatory and Responsible AI requirements into the platform architecture.
• Drive cost optimisation across compute, storage and AI inference workloads while maintaining resilience, reliability and performance.
• Represent the AI platform within architecture and technology governance forums.
• Work with data scientists, ML engineers, platform engineers, product teams and business stakeholders to enable a broad range of AI workloads.
• Provide technical guidance, troubleshoot complex platform challenges and mentor engineering teams.

What We're Looking For

You'll bring proven experience designing and architecting enterprise-scale AI/ML platforms, ideally across both Azure and AWS.

You should have:

• Strong experience architecting AI/ML platforms in complex cloud environments.
• Deep knowledge of ML platform capabilities including training pipelines, orchestration, feature stores, model hosting, observability and MLOps.
• Strong Generative AI architecture experience, including LLMs, RAG, vector databases, prompt orchestration, guardrails and evaluation frameworks.
• Excellent understanding of multi-cloud architecture, networking, IAM, security and cross-cloud integration.
• Experience assessing and selecting AI technologies such as MLflow, Kubeflow, SageMaker, Azure Machine Learning, Databricks, vector databases and inference frameworks.
• Knowledge of Responsible AI, data protection and AI governance, including GDPR and model risk management principles.
• Strong architecture modelling and technical documentation skills.
• Experience designing scalable and cost-efficient architectures for AI training, fine-tuning and inference.
• The ability to solve complex technical problems and provide architectural leadership to engineering teams.
• Experience working within a large enterprise or regulated environment would be advantageous, particularly financial services or insurance.

Why Join?

You'll have the opportunity to play a key role in shaping an enterprise AI capability, influencing technology strategy and enabling teams to deliver innovative AI solutions at scale.

• Annual discretionary bonus
• Up to 11% employer pension contribution
• Hybrid working and flexible hours
• 25 days' annual leave plus bank holidays
• Option to buy or sell annual leave
• Health and wellbeing support, including virtual GP
• Career development and mentoring
• Inclusive culture and employee networks
• Share investment options

If you're an experienced AI/ML architect who enjoys solving complex platform challenges and wants to shape the architecture behind enterprise-scale AI, we'd like to hear from you.