Ai Infrastructure Lead Architect

Accenture PLC

Madrid

On-site

EUR 140,000 - 200,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Accenture is seeking an experienced Lead and Principal Infrastructure Architect to own end-to-end compute infrastructure design for large-scale AI/ML systems, including distributed training environments. You will translate business goals and SLAs into scalable, cost-efficient architectures across compute, networking, storage, orchestration, and model serving.

You will lead architecture decisions, set technical direction, mentor engineers, and collaborate with clients to shape roadmaps while

Qualifications

  • Solid background in coding, building, monitoring, troubleshooting applications of AI/ML models; selecting, designing and infrastructure for deploying and running them on premise or on public cloud.

Responsibilities

  • Own the end-to-end architecture and design of optimized compute infrastructure for large-scale AI/ML systems, including large-scale distributed training environments.
  • Develop and evaluate architecture alternatives across compute, networking, storage, orchestration, and model serving.
  • Lead architecture assessments and reviews identifying gaps, risks, bottlenecks, and optimization opportunities.

Skills

Python
Java
C++
AI/ML infrastructure
Data pipelines
Airflow
Kubeflow
Problem solving
Communication
Project management

Education

Bachelor's Degree in Computer Science/Engineering

Tools

Apache Airflow
Kubeflow

Job description

YOU ARE As a Lead and Principal Infrastructure Architect, you own end-to-end responsibility for designing optimized compute infrastructure for large-scale AI and machine learning systems, including large-scale distributed training environments. You are the authority who translates business goals, SLAs, and client standards into infrastructure architectures that perform at scale while being deliberately engineered for cost-efficiency. Drawing on deep experience, you weigh multiple viable solutions for any given problem — across compute, networking, storage, orchestration, and model serving — and make rational, well-justified architectural decisions tailored to each client's situation, constraints, and standards. You architect and optimize the full computational stack for performance, power, cost, and scalability; design and tune large-scale GPU clusters and distributed training systems; and ensure infrastructure meets security, compliance, and regulatory requirements. As the recognized AI infrastructure expert in at least one hyperscaler cloud (such as AWS, Azure, or Google Cloud), you bring authoritative knowledge of that platform's AI/ML services, accelerators, networking, and cost levers, and apply it to deliver best-in-class solutions. Beyond design, you set technical direction and standards, lead and mentor engineers and architects, partner with clients and stakeholders to shape the infrastructure roadmap, and are ultimately accountable for delivering AI/ML infrastructure that meets business SLAs, controls cost, and scales to enterprise and frontier workloads.

THE WORK
  • Own the end-to-end architecture and design of optimized compute infrastructure for large-scale AI/ML systems, including large-scale distributed training environments, from concept through delivery.
  • Develop and evaluate architecture alternatives, weighing trade-offs across compute, networking, storage, orchestration, and model serving to make rational, well-justified decisions tailored to each client's situation and standards.
  • Lead architecture assessments and reviews of existing and proposed environments, identifying gaps, risks, bottlenecks, and optimization opportunities, and recommending remediation.
  • Drive architectural decision-making, documenting rationale, trade-offs, and assumptions so decisions are transparent, defensible, and aligned with business SLAs and standards.
  • Define and maintain the AI infrastructure roadmap, planning capacity, scaling, and technology evolution in step with business and product goals.
  • Architect and optimize the full computational stack for performance, power, cost, and scalability, ensuring infrastructure meets business SLAs while being deliberately engineered for cost-efficiency.
  • Design and tune large-scale GPU clusters and distributed training systems, including accelerator selection, interconnect/networking, and storage for high-throughput training workloads.
  • Serve as the authoritative AI infrastructure expert in at least one hyperscaler cloud (AWS, Azure, or GCP), applying deep knowledge of its AI/ML services, accelerators, networking, and cost levers.
  • Design deployment, automation, and CI/CD strategies for reliable, repeatable, and scalable releases of AI systems, models, and data pipelines into production.
  • Establish AI monitoring and observability strategy across InfraOps and MLOps, defining SLAs, SLOs, alerting, and performance/cost tracking, and driving continuous optimization.
  • Integrate AI/ML systems into enterprise environments, ensuring interoperability, security, compliance, and adherence to regulatory and client standards.
  • Lead capacity planning and cost modeling, forecasting compute needs and engineering cost-efficiency into the architecture without compromising performance.
  • Collaborate with clients, stakeholders, and engineering teams to align infrastructure decisions with business outcomes, translating requirements into actionable architecture and standards.
  • Set technical direction, standards, and best practices, mentoring engineers and architects and leading design and code reviews across the team.
EDUCATION

Bachelor's Degree in Computer Science, Computer Engineering, related Engineering field

BASIC (REQUIRED) QUALIFICATION
  • Solid background in coding, building, monitoring, troubleshooting applications of AI/ML models; selecting, designing and infrastructure for deploying and running them on premise or on public cloud.
  • Strong understanding of AI and machine learning as a subject.
  • Strong understanding of computing infrastructure a subject, preferred knowledge of AI infrastructure.
  • Good proficiency in programming languages such as Python, Java, or C++.
  • Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow).
  • Strong problem-solving skills and ability to work in a fast-paced environment.
  • Excellent communication and collaboration skills.
  • Significant experience in AI/ML infrastructure engineering or related roles on a hyperscaler platform for deploying large scale solutions.
  • Proven experience in leading and managing AI projects and teams.
  • Strong project management skills, with the ability to manage multiple projects simultaneously.
  • Demonstrated experience in evaluating and selecting AI technologies and frameworks.
  • Ability to work with cross-functional teams and drive project alignment.
About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360 value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360 value we create for our clients, each other, our shareholders, partners and communities. Visit us at

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, sexual orientation, gender identity or expression, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Manager | Security for AI
Senior Manager | Security for AI

Accenture PLC • Madrid

On-site
EUR 140,000 - 190,000
Medical insurance
Wellness programs
Flexible compensation
+4
AI Manager | Spain
AI Manager | Spain

Accenture PLC • Madrid

On-site
EUR 90,000 - 135,000
Forward Deployed Engineer Manager
Forward Deployed Engineer Manager

6000 Accenture S.L. Company • Madrid

On-site
EUR 90,000 - 120,000
AI Native Software Engineer - Senior Analyst
AI Native Software Engineer - Senior Analyst

Accenture PLC • Málaga

On-site
EUR 55,000 - 85,000
Senior AI Infra Architect: Scalable GPU Clusters & Cloud Strategy
Senior AI Infra Architect: Scalable GPU Clusters & Cloud Strategy

Accenture PLC • Madrid

On-site
EUR 140,000 - 200,000
Enterprise AI Value Strategy Consultant
Enterprise AI Value Strategy Consultant

6000 Accenture S.L. Company • Cataluña

Hybrid
EUR 70,000 - 110,000
Flexible work arrangements
Competitive benefits package
Enterprise AI Value Strategy Analyst
Enterprise AI Value Strategy Analyst

6000 Accenture S.L. Company • Cataluña

Hybrid
EUR 65,000 - 90,000
Enterprise AI Value Strategy Manager
Enterprise AI Value Strategy Manager

6000 Accenture S.L. Company • Cataluña

Hybrid
EUR 120,000 - 170,000
Training programs in Data & AI
Flexible work arrangements
Competitive benefits package
Enterprise Ai Value Strategy Analyst
Enterprise Ai Value Strategy Analyst

Accenture PLC • Madrid

On-site
EUR 70,000 - 110,000
Senior Principal AI Architect
Senior Principal AI Architect

Keysight Technologies • Barcelona

On-site
EUR 120,000 - 180,000