Senior AI Infrastructure Architect for Enterprise Scale

Mastercard

Austin (TX)

On-site

USD 170,000 - 281,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Mastercard is seeking a Principal AI Infrastructure Engineer to build and scale next‑generation AI platforms across compute, storage, networking, and accelerators. The role focuses on enabling high‑performance, scalable infrastructure for ML and AI workloads.

You will lead the on‑prem private cloud roadmap, act as product owner for AI infrastructure, and collaborate with data science, MLOps, security, and legal teams to ensure responsible AI standards and governance.

Qualifications

  • Bachelor’s degree in CS, Electronics, or related engineering field is required.
  • Significant experience in large-scale infrastructure, platform engineering, or systems architecture.
  • Proven experience owning infrastructure roadmaps and delivering in private/on-prem clouds.
  • Strong knowledge of AI/ML concepts, data science workflows, and MLOps.
  • Familiarity with Generative AI and Agentic AI architectures and requirements.

Responsibilities

  • Lead AI infrastructure roadmap for Mastercard’s on-premise private cloud, spanning strategy, design, procurement, delivery, installation, and lifecycle management.
  • Act as a product owner for AI infrastructure, translating business and data science needs into scalable platform capabilities.
  • Lead RFIs/RFPs for AI infrastructure components, including CPU, GPU, storage, and networking.
  • Architect and scale infrastructure capable of training large scale models with real-time and batch inference across global workloads.
  • Define modern AI infrastructure standards, including high performance storage, high-speed networking, and data center requirements.
  • Partner with data science, MLOps, and platform teams to align infra with model development and deployment lifecycles.
  • Collaborate with security, governance, compliance, and legal to meet regulatory and ethical AI standards.
  • Influence senior leadership with clear trade-offs, ROI, and risk considerations through executive presentations.
  • Stay ahead of industry trends in AI infrastructure and agentic AI to inform long-term strategy.

Skills

AI infrastructure
RFI/RFP management
Executive communication
Cross-functional collaboration
Compute & networking
Private cloud

Education

Bachelor’s degree in Computer Science, Electronics, or related engineering field

Job description

Mastercard is seeking a Principal AI Infrastructure Engineer to build and scale next‑generation AI platforms across compute, storage, networking, and accelerators. The role focuses on enabling high‑performance, scalable infrastructure for ML and AI workloads.

You will lead the on‑prem private cloud roadmap, act as product owner for AI infrastructure, and collaborate with data science, MLOps, security, and legal teams to ensure responsible AI standards and governance.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Principal AI Platform Engineer — Scale Enterprise AI Infra
Principal AI Platform Engineer — Scale Enterprise AI Infra

Mastercard • San Carlos (CA)

On-site
USD 204,000 - 337,000
Senior AI Infrastructure Architect
Senior AI Infrastructure Architect

Mastercard • Arlington (VA)

On-site
USD 195,000 - 323,000
Senior AI Infrastructure Architect
Senior AI Infrastructure Architect

Mastercard • Arlington (VA)

On-site
USD 195,000 - 323,000
AI Platform Architect for Enterprise-Scale Infra
AI Platform Architect for Enterprise-Scale Infra

Mastercard • Missouri

On-site
USD 170,000 - 281,000
Health insurance
401k with company match
Paid parental leave
+1
Remote Principal AI Infrastructure Engineer
Remote Principal AI Infrastructure Engineer

Mastercard • Arlington (VA)

On-site
USD 195,000 - 323,000
Senior AI Platform & Infrastructure Architect
Senior AI Platform & Infrastructure Architect

Mastercard • Miami (FL)

On-site
USD 170,000 - 281,000
Health insurance
401k match
Paid time off
+1
AI Platform Engineer Lead: Enterprise-Scale Infra
AI Platform Engineer Lead: Enterprise-Scale Infra

Mastercard • New York (NY)

On-site
USD 204,000 - 337,000
401k with match
On-site fitness facilities
Tuition reimbursement
+1
Principal AI Infrastructure Architect
Principal AI Infrastructure Architect

Mastercard • Atlanta (GA)

On-site
USD 170,000 - 281,000
Lead AI Infrastructure Architect - Private Cloud & GenAI
Lead AI Infrastructure Architect - Private Cloud & GenAI

Mastercard • Boston (MA)

On-site
USD 196,000 - 323,000
Insurance benefits
401k with company match
Paid time off
+1
Senior AI Platform Engineer: Scalable ML Ops & Cloud
Senior AI Platform Engineer: Scalable ML Ops & Cloud

Mastercard • Austin (TX)

On-site
USD 115,000 - 184,000
Health insurance
401k with company match
Paid time off & parental leave