AI Infrastructure Lead Architect - Cyber Security (All Genders)

Accenture DACH

Kronberg im Taunus

On-site

EUR 150,000 - 190,000

Full time

7 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Accenture DACH is seeking a Principal AI Infrastructure Architect to lead compute infrastructure strategies for large-scale AI/ML systems. You will define reference architectures, drive cost-aware, secure deployments, and mentor the architect community across engagements, with hands-on prototyping and strong collaboration with partners.

The role demands expert knowledge of hyperscalers, AI services, accelerators, and reliability, with a focus on delivering business value while meeting demanding

Qualifications

  • Significant experience coding and deploying AI/ML on compute infrastructure.
  • Cyber security industry experience.
  • Experience designing AI infrastructure on hyperscalers.
  • Proficient in Python, Java, or C++.
  • German language at B2 level or higher.

Responsibilities

  • Set the overarching technical vision for compute infrastructure for AI/ML systems.
  • Own complex architecture decisions across compute, networking, storage, and orchestration.
  • Architect and prototype large-scale, cost-optimized AI compute and distributed training systems.
  • Define reference architectures, standards, and patterns across engagements.

Skills

AI infra
Python
Java
C++
Hyperscaler cloud

Education

Bachelor's Degree in Computer Science or related field

Tools

Kubernetes
Terraform
Apache Airflow

Job description

AI Infrastructure Architect - Cyber Security

and

YOU ARE

As a Principal AI Infrastructure Architect, you are the firm's most senior technical authority on compute infrastructure for large-scale AI and machine learning systems, bringing extensive experience as a lead and senior architect along with command over a broad landscape of technological options and the latest innovations that can be introduced into a solution. You have a proven track record of successfully designing and deploying large-scale infrastructure on which significant AI/ML solutions operate in production and demonstrably deliver business value — not just systems that perform, but systems that move the needle for the organizations they serve. You weigh and rationalize multiple viable architectures across compute, networking, storage, orchestration, and model serving, making authoritative decisions tailored to each client's situation, standards, and strategic objectives, and you set the technical direction that senior and lead architects build upon. As a recognized expert across at least one hyperscaler cloud — and conversant across several — you bring deep, current knowledge of AI/ML services, accelerators, interconnects, and cost levers, and you continuously scan the horizon to identify promising emerging technologies and judge where and when they belong in a real solution. You are well known to our infrastructure partners and partnering organizations, maintaining strong relationships that give the firm early access, influence, and insight, and you represent the practice's technical credibility in those forums. Beyond architecture, you shape strategy and roadmaps, establish standards and reference architectures, mentor and elevate the architect community, and are ultimately accountable for ensuring the firm delivers AI/ML infrastructure that meets business SLAs, controls cost, scales to frontier workloads, and creates lasting business value.

THE WORK
  • Set the overarching technical vision and strategy for compute infrastructure supporting large-scale AI/ML systems, establishing the direction that senior and lead architects build upon.
  • Own the most complex, high-stakes architecture decisions across compute, networking, storage, orchestration, and model serving, rationalizing multiple viable options and making authoritative choices aligned to client situations, standards, and strategic objectives.
  • Architect and hands‑on prototype large-scale, cost‑optimized compute and distributed training systems — building reference implementations, proofs‑of‑concept, and benchmarks to validate designs before they scale.
  • Define reference architectures, standards, and architectural patterns that scale across engagements, and personally implement the foundational tooling, infrastructure‑as‑code, and automation that anchor them.
  • Lead enterprise-scale architecture assessments and design reviews, getting hands‑on in the environment to validate findings, profile real workloads, and demonstrate optimization opportunities.
  • Shape and steward the AI infrastructure roadmap and technology strategy, planning capacity, scaling, and technology evolution in step with long‑term business goals.
  • Identify, evaluate, and hands‑on pilot promising emerging technologies and innovations, building and testing them in real conditions to judge where and when they belong in a solution.
  • Drive hands‑on performance and cost optimization of the computational stack, profiling GPU/compute utilization, tuning distributed training and model‑serving workloads, and engineering improvements to meet SLAs while controlling cost.
  • Serve as the principal authority across hyperscaler cloud platforms, with current, hands‑on expertise in AI/ML services, accelerators, interconnects, and cost levers, and breadth across multiple providers.
  • Lead deep, hands‑on troubleshooting and root‑cause analysis of the most complex issues across the stack — hardware, networking, software, and models — resolving the problems others cannot and codifying the fixes.
  • Cultivate and lead relationships with infrastructure partners and partnering organizations, securing early access, influence, and insight, and representing the practice's technical credibility in those forums.
  • Provide executive- and client-level technical advisory, translating complex infrastructure trade-offs into clear, defensible recommendations tied to business outcomes.
  • Define monitoring, observability, and reliability strategy across InfraOps and MLOps, and implement the instrumentation, SLAs, SLOs, and cost/performance governance for production AI/ML systems.
  • Ensure enterprise integration, security, compliance, and regulatory alignment of AI/ML infrastructure across the firm's solutions.
  • Mentor, elevate, and grow the architect community, developing senior and lead architects through hands‑on pairing, design collaboration, and code/architecture reviews.
  • Champion cost‑efficiency and value realization, ensuring infrastructure not only performs and scales but demonstrably moves the needle for the organizations it serves.
EDUCATION
  • Bachelor's Degree in Computer Science, Computer Engineering, related Engineering field
Basic (required) Qualification
  • Significant experience in coding, building, monitoring, troubleshooting applications of AI/ML models; selecting, designing and infrastructure for deploying and running them on premise or on public cloud.
  • Experience in Cyber Security Industry
  • Considerable experience in AI/ML infrastructure engineering or related roles on a hyperscaler platform for deploying large scale solutions.
  • Strong understanding of AI and machine learning as a subject.
  • Strong understanding of computing infrastructure a subject, preferred knowledge of AI infrastructure.
  • Proficiency in programming languages such as Python, Java, or C++.
  • Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow).
  • Strong problem‑solving skills and ability to work in a fast‑paced environment.
  • Excellent communication and collaboration skills.
  • Proven experience in leading and managing AI projects and teams.
  • Strong project management skills, with the ability to manage multiple projects simultaneously.
  • Demonstrated experience in evaluating and selecting AI technologies and frameworks.
  • Ability to work with cross‑functional teams and drive project alignment.
  • German on minimum B2 level.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Architect (All Genders)
AI Infrastructure Architect (All Genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 110,000 - 170,000
AI Infrastructure Architect - Infrastructure & Capital Projects Engineering (All Genders)
AI Infrastructure Architect - Infrastructure & Capital Projects Engineering (All Genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 120,000 - 190,000
AI Infrastructure Principal Architect (all genders)
AI Infrastructure Principal Architect (all genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 150,000 - 190,000
Certifications & learning
Strategy shaping
Career growth
AI Infrastructure Principal Architect
AI Infrastructure Principal Architect

Accenture UK • Berlin

On-site
EUR 120,000 - 180,000
AI Infrastructure Lead Architect
AI Infrastructure Lead Architect

Accenture UK • Berlin

On-site
EUR 150,000 - 230,000
Lead AI Architect
Lead AI Architect

IBM • München

On-site
EUR 70,000 - 100,000
Principal AI Infrastructure Architect (Senior/Managerial role)
Principal AI Infrastructure Architect (Senior/Managerial role)

Accenture • Germany

Hybrid
EUR 180,000 - 280,000
Employer-funded pension scheme
Employee Share Purchase Programme (ESP
Flexible working models
AI Architect(m/f/d)
AI Architect(m/f/d)

NC GROUP GmbH • Berlin

On-site
EUR 80,000 - 120,000
28 vacation days
Health & Sports Subsidy
Public Transportation Subsidy
+2
AI/ML Computational Scientist Manager (All Genders)
AI/ML Computational Scientist Manager (All Genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 90,000 - 140,000
AI Engineer (all levels)
AI Engineer (all levels)

Secure Systems Engineering GmbH • Berlin

Hybrid
EUR 60,000 - 90,000
Flexible hybrid working
Comfortable travel policy
Continuous training programs