Principal AI Platform Engineer — Scale Enterprise AI Infra

Mastercard

San Carlos (CA)

On-site

USD 204,000 - 337,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mastercard is seeking a Principal AI Infrastructure Engineer to build and scale the next generation of infrastructure for AI workloads across compute, storage, networking, and accelerators. The role leads the on‑prem private cloud roadmap, acts as a product owner for AI infrastructure, and collaborates with data science, MLOps, security, and finance to deliver scalable, responsible AI at enterprise scale.

This role requires deep technical depth, executive communication, and a builder mindset to

Qualifications

  • Bachelor’s degree in a technical field and substantial enterprise infrastructure experience.
  • Strong knowledge of AI/ML concepts, data science workflows, and MLOps.
  • Experience in RFIs/RFPs, vendor evaluation, and investment decisions.
  • Ability to influence senior stakeholders and balance cost with performance.
  • Familiarity with on-prem or private cloud infrastructure at scale.

Responsibilities

  • Lead AI infrastructure roadmap for Mastercard’s on‑prem private cloud and lifecycle management.
  • Act as a product owner translating data science needs into scalable platform capabilities.
  • Lead RFIs and RFPs for AI infrastructure components with cross‑functional stakeholders.
  • Architect and scale infrastructure for training large models with low latency inference.
  • Define modern AI infra standards including storage, networking, cooling, and power design.
  • Partner with data science, MLOps, security, and governance teams for responsible AI.
  • Collaborate with enterprise architecture, legal, and finance for risk and compliance.
  • Present trade-offs and ROI to executives with structured narratives.
  • Stay ahead of Generative AI and agentic AI trends and vendor ecosystems.

Skills

AI/ML concepts
MLOps practices
Generative AI
Agentic AI architectures
Compute (CPU/GPU)
High density AI infra
RFIs/RFPs
Executive communication
Product thinking
Vendor evaluation

Education

Bachelor’s degree in Computer Science or related engineering field

Job description

Mastercard is seeking a Principal AI Infrastructure Engineer to build and scale the next generation of infrastructure for AI workloads across compute, storage, networking, and accelerators. The role leads the on‑prem private cloud roadmap, acts as a product owner for AI infrastructure, and collaborates with data science, MLOps, security, and finance to deliver scalable, responsible AI at enterprise scale.

This role requires deep technical depth, executive communication, and a builder mindset to

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Platform Architect for Enterprise-Scale Infra
AI Platform Architect for Enterprise-Scale Infra

Mastercard • Missouri

On-site
USD 170,000 - 281,000
Health insurance
401k with company match
Paid parental leave
+1
Remote Principal AI Infrastructure Engineer
Remote Principal AI Infrastructure Engineer

Mastercard • Arlington (VA)

On-site
USD 195,000 - 323,000
Senior AI Platform & Infrastructure Architect
Senior AI Platform & Infrastructure Architect

Mastercard • Miami (FL)

On-site
USD 170,000 - 281,000
Health insurance
401k match
Paid time off
+1
AI Platform Engineer Lead: Enterprise-Scale Infra
AI Platform Engineer Lead: Enterprise-Scale Infra

Mastercard • New York (NY)

On-site
USD 204,000 - 337,000
401k with match
On-site fitness facilities
Tuition reimbursement
+1
Principal AI Infrastructure Architect
Principal AI Infrastructure Architect

Mastercard • Atlanta (GA)

On-site
USD 170,000 - 281,000
Senior AI Infrastructure Architect
Senior AI Infrastructure Architect

Mastercard • Arlington (VA)

On-site
USD 195,000 - 323,000
Lead AI Platform & Infrastructure Architect
Lead AI Platform & Infrastructure Architect

MasterCard • Austin (TX)

On-site
USD 170,000 - 281,000
Lead AI Infrastructure Architect - Private Cloud & GenAI
Lead AI Infrastructure Architect - Private Cloud & GenAI

Mastercard • Boston (MA)

On-site
USD 196,000 - 323,000
Insurance benefits
401k with company match
Paid time off
+1
Senior AI Platform Engineer - Cloud | MLOps & Scale
Senior AI Platform Engineer - Cloud | MLOps & Scale

Mastercard • Atlanta (GA)

On-site
USD 115,000 - 184,000
Health insurance
401k with company match
Paid time off
+1
Principal AI Security Architect
Principal AI Security Architect

Mastercard • O’Fallon (MO)

On-site
USD 170,000 - 281,000
Insurance (medical)
FSA/HSA
Paid parental leave
+2