AI Infrastructure Architect

Accenture PLC

Deutschland

On-site

EUR 120,000 - 170,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Accenture PLC is seeking a hands-on AI Infrastructure Architect in Germany to design and optimize AI and ML infrastructure powering real-world applications. You will code, deploy, monitor, and troubleshoot AI systems, GPU clusters, and data pipelines across cloud and on-prem environments.

You will mentor engineers, lead streams, and set architectural standards while focusing on performance, cost, and security. Fluency in German (B2) is required.

Qualifications

  • Hands-on AI/ML infrastructure with coding, testing, and deployment expertise.
  • Strong AI/ML knowledge and computing infrastructure fundamentals.
  • Proficiency in Python, Java, or C++.
  • Experience with data pipelines (Airflow, Kubeflow).
  • Ability to work in a fast-paced environment and collaborate.
  • German language at least B2 level.

Responsibilities

  • Write, review, and debug code, scripts, and infrastructure-as-code for AI infrastructure, automation, and tooling.
  • Architect, configure, and provision compute resources across cloud and on-premises environments, including GPU clusters and distributed training setups.
  • Design and maintain deployment automation and CI/CD pipelines for reliable releases of AI systems, models, and apps.
  • Deploy AI systems, models, and data pipelines into production, defining and improving processes and best practices.
  • Lead container orchestration and model serving using Docker, Kubernetes, and deployment frameworks.
  • Architect and optimize the computational stack for performance, power, cost, and scalability.

Skills

Python
Java
C++
Docker
Kubernetes
German B2
CI/CD
AI/ML infra

Education

Bachelor's Degree in CS/CE

Tools

Kubeflow
Airflow
Terraform

Job description

YOU ARE

As a hands-on AI Infrastructure Architect, you are an experienced engineer with several years in infrastructure engineering who now takes on more complex, higher-impact work designing and optimizing the AI and machine learning infrastructure that powers real-world applications. Working alongside senior architects and engineers - and increasingly leading your own workstreams - you apply proven skills in coding, testing, configuring, deploying, monitoring, and troubleshooting AI systems and the infrastructure they run on. Day to day, you architect and optimize infrastructure components, write and review code and deployment scripts, design and tune cloud and on-premises compute resources such as GPU clusters and distributed training environments, deploy AI systems and models into production, and build and optimize data pipelines that feed AI and ML workflows. You optimize the computational stack for performance, cost, power, and scalability, monitor AI systems and infrastructure health across both InfraOps and MLOps disciplines, perform AI monitoring to track model and system performance, and independently troubleshoot and resolve complex issues across the stack. You also mentor junior engineers, contribute to architectural decisions, and help establish best practices. This is a hands-on, ownership-driven role where you apply and deepen your expertise across modern tools and platforms - including container orchestration, model serving, CI/CD pipelines, InfraOps, MLOps, and AI monitoring - while making meaningful contributions to infrastructure that enables AI-driven business outcomes.

THE WORK
  • Write, review, and debug code, scripts, and infrastructure-as-code for AI infrastructure, automation, and tooling, setting standards for quality across the team.
  • Architect, configure, and provision compute resources across cloud and on-premises environments, including GPU clusters and distributed training setups, optimizing for performance and utilization.
  • Design and maintain deployment automation and CI/CD pipelines to support reliable, repeatable releases of AI systems, models, and applications.
  • Deploy AI systems, models, and data pipelines into production, defining and improving the processes and best practices others follow.
  • Lead container orchestration and model serving using tools such as Docker, Kubernetes, and model deployment frameworks.
  • Architect and optimize the computational stack for performance, power, cost, and scalability, balancing trade-offs against business goals.
  • Evaluate and select tools, frameworks, and platforms, making recommendations that shape the infrastructure roadmap.
  • Integrate AI models and systems into existing enterprise systems, ensuring interoperability, security, and regulatory compliance.
  • Own AI monitoring and infrastructure health across InfraOps and MLOps, tracking performance, reliability, and utilization, and driving remediation.
  • Independently troubleshoot and resolve complex issues across the computational stack - hardware, networking, software, and models - and lead root-cause analysis.
  • Mentor junior engineers and lead code reviews, providing technical direction and supporting their growth.
  • Define and document architecture standards, processes, and procedures, and apply security, cost-efficiency, and scalability best practices across the infrastructure.
EDUCATION
  • Bachelor's Degree in Computer Science, Computer Engineering, related Engineering field
BASIC (REQUIRED) QUALIFICATION
  • Practical experience in coding, building, monitoring, troubleshooting applications of AI/ML models; selecting, designing and infrastructure for deploying and running them on premise or on public cloud.
  • Strong understanding of AI and machine learning as a subject.
  • Strong understanding of computing infrastructure a subject, preferred knowledge of AI infrastructure.
  • Proficiency in programming languages such as Python, Java, or C++.
  • Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow).
  • Strong problem-solving skills and ability to work in a fast-paced environment.
  • Excellent communication and collaboration skills.
  • Proven experience in AI/ML infrastructure engineering or related roles on a hyperscaler platform for deploying large scale solutions.
  • German on minimum B2 level.
About Accenture

Accenture is a leading global professional services company that helps the world's leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services - creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world's leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360 value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360 value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Infrastructure Architect (Senior/Managerial role)
Principal AI Infrastructure Architect (Senior/Managerial role)

Accenture PLC • Germany

Hybrid
EUR 180,000 - 280,000
Employer-funded pension scheme
Employee Share Purchase Programme (ESP
Flexible working models
AI Infrastructure Principal Architect (all genders)
AI Infrastructure Principal Architect (all genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 150,000 - 190,000
Certifications & learning
Strategy shaping
Career growth
AI Infrastructure Architect - Infrastructure & Capital Projects Engineering (All Genders)
AI Infrastructure Architect - Infrastructure & Capital Projects Engineering (All Genders)

3200 Accenture GmbH Company • Kronberg im Taunus

On-site
EUR 90,000 - 150,000
AI Infrastructure Architect (All Genders)
AI Infrastructure Architect (All Genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 110,000 - 170,000
AI Infrastructure Architect (All Genders)
AI Infrastructure Architect (All Genders)

3200 Accenture GmbH Company • Kronberg im Taunus

On-site
EUR 110,000 - 140,000
AI Infrastructure Architect - Infrastructure & Capital Projects Engineering (All Genders)
AI Infrastructure Architect - Infrastructure & Capital Projects Engineering (All Genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 120,000 - 190,000
AI LLM Technology Architecture Senior Manager (All Genders)
AI LLM Technology Architecture Senior Manager (All Genders)

Accenture DACH • Kronberg im Taunus

Hybrid
EUR 120,000 - 190,000
Flexible working models
AI training opportunities
AI Large Language Model Technology Lead / Principal Architect (all genders)
AI Large Language Model Technology Lead / Principal Architect (all genders)

Accenture DACH • Kronberg im Taunus

On-site
EUR 120,000 - 190,000
AI Infrastructure Principal Architect (all genders)
AI Infrastructure Principal Architect (all genders)

3200 Accenture GmbH Company • Kronberg im Taunus

Hybrid
EUR 150,000 - 230,000
Industry-leading AI/cloud/infra certs
Shape AI infra strategy for global 클</
Flexible working environment and long‑
AI Infrastructure Lead Architect - Cyber Security (All Genders)
AI Infrastructure Lead Architect - Cyber Security (All Genders)

3200 Accenture GmbH Company • Kronberg im Taunus

On-site
EUR 140,000 - 220,000