Senior AI Platform & Infra Architect

Mastercard; United States; Remote; USD 195,000 - 323,000; Full time

Benefits offered by this job

Healthcare benefits

401k with match

Paid leave & holidays

Job summary

Mastercard is seeking a Principal AI Infrastructure Engineer to build and scale next-generation infrastructure supporting AI workloads across compute, storage, networking, and accelerators. You will own the on-premise private cloud roadmap and partner with data science, MLOps, and platform teams to enable enterprise AI capabilities.

The role requires deep technical knowledge of AI infrastructure, RFIs/RFPs, and collaboration with security and governance groups to ensure ethical and compliant AI

Qualifications

• Bachelor’s degree in Computer Science, Electronics, or a related engineering field.
• Extensive experience in large-scale infrastructure, platform engineering, or systems architecture within a complex enterprise.
• Experience owning infrastructure roadmaps and delivering in on premise or private clouds at scale.
• Knowledge of AI/ML concepts, data science workflows, MLOps practices, and model lifecycle management.
• Familiarity with Generative AI and Agentic AI architectures and their unique infrastructure requirements.
• Deep understanding of compute (CPU/GPU), high performance storage, and networking in AI platforms.
• Hands on or architectural exposure to high density, high power AI infrastructure including cooling and power considerations.
• Strong product thinking—balancing user needs, feasibility, cost and evolution of the platform.
• Ability to influence in a large, matrixed organization and present to senior leaders.
• Curious, forward looking, and passionate about enterprise-scale AI foundations.

Responsibilities

• Lead AI infrastructure roadmap for Mastercard’s on premise private cloud, spanning strategy, design, procurement, delivery, installation, and lifecycle management.
• Act as a product owner for AI infrastructure, translating business and data science needs into scalable platform capabilities for ML and AI workloads.
• Lead RFIs and RFPs for AI infrastructure components, including CPU, GPU, storage, and networking, with vendor evaluation criteria.
• Architect and scale infrastructure capable of training large-scale models on petabytes of data, with low latency inference across global workloads.
• Define and champion modern AI infrastructure standards, including high performance storage, networking, and data center requirements.
• Partner with data science, MLOps, and platform teams to align infrastructure with model development and deployment.
• Collaborate with security, governance, compliance, and legal teams to meet regulatory and ethical AI standards.
• Influence senior leadership with clear trade-offs, ROI, and risk through executive presentations.
• Stay ahead of industry trends in AI infrastructure, Generative AI and Agentic AI, informing long-term strategy.

Skills

AI infrastructure

Platform engineering

RFIs/RFPs

Executive communication

Vendor management

Education

Bachelor’s degree in Computer Science/Engineering

Job description

Mastercard is seeking a Principal AI Infrastructure Engineer to build and scale next-generation infrastructure supporting AI workloads across compute, storage, networking, and accelerators. You will own the on-premise private cloud roadmap and partner with data science, MLOps, and platform teams to enable enterprise AI capabilities.

The role requires deep technical knowledge of AI infrastructure, RFIs/RFPs, and collaboration with security and governance groups to ensure ethical and compliant AI