AI Infrastructure Architect

HITEC

United States

On-site

USD 180,000 - 342,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Kyndryl is seeking an experienced enterprise architecture leader to own end-to-end design decisions for AI factory deliverables across compute, storage, networking, and security. You will document decisions, mentor engineers, and ensure risk-free deployments for clients in diverse data-center environments.

Candidates should have a minimum of 10 years in data center, HPC, cloud, or distributed infrastructure, with strong communication to executives and customers.

Qualifications

  • 10+ years in data center, HPC, cloud, platform, or distributed infrastructure.
  • Experience leading architecture across compute, network, storage, or facilities.
  • Customer-facing technical leadership, risk management, and executive communication.

Responsibilities

  • Lead discovery and translate workload, scale, performance, availability, security, and data-locality into executable architecture.
  • Document deviations, risks, assumptions, and rationale for chosen patterns.
  • Define rack elevation, power density, redundancy, cooling, and capacity headroom with facilities teams.
  • Produce and approve high-level and low-level designs, BOM, topology, and security requirements.
  • Chair architecture reviews and resolve cross-domain decisions with stakeholders.
  • Define expansion boundaries, lifecycle strategy, and Day 2 operating model for the system.
  • Mentor engineers and ensure design authority through build, validation, and production handoff.

Skills

Architecture leadership
Customer-facing leadership
Executive communication
Mentoring engineers
Design governance
Risk management
Growth mindset

Tools

NVIDIA DGX/HGX
InfiniBand
Spectrum-X
NVLink/NVSwitch
RoCE / Ethernet

Job description

Who We Are

At Kyndryl, we design, build, manage and modernize the mission‑critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

The Role

Accountable for the end-to-end architecture and technical decisions that keep the AI factory deliverable, supportable, and acceptable to the customer. Provides design authority across facilities, compute, fabric, storage, platform, security, and lifecycle, and ensures risks are resolved before equipment arrives.

Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment.

Who You Are

You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.

Key Responsibilities
  • Lead discovery and convert workload, scale, performance, availability, security, compliance, data-locality, and operating-model requirements into an executable architecture.
  • Select the appropriate NVIDIA reference architecture, OEM validated design, or supported equivalent pattern and document deviations, risks, assumptions, and decision rationale.
  • Design compute, GPU, accelerator interconnect (for example NVLink/NVSwitch), InfiniBand or RoCE/Ethernet fabrics (for example Spectrum‑X), storage, management, out-of-band, and service‑network planes.
  • Define rack elevation, power density, redundancy, cooling or liquid-loop requirements, floor loading, containment, service clearances, failure domains, and capacity headroom with facilities teams.
  • Produce and approve HLD, LLD, BOM, topology, IP plan, port and cable matrix, compatibility matrix, security requirements, implementation guidance, test strategy, and acceptance criteria.
  • Chair architecture and design reviews; resolve cross‑domain decisions with customer, OEM, network, storage, platform, facilities, security, and operations stakeholders.
  • Define expansion units, scale boundaries, lifecycle strategy, upgrade paths, rollback principles, and Day 2 operating model.
  • Mentor engineers and retain design authority through build, commissioning, validation, production handoff, and optimization.
Required Professional Experience
  • 10+ years in data center, HPC, cloud, platform, or distributed infrastructure, including architecture leadership.
  • Depth in at least two of compute, network/fabric, storage, or facilities, with working fluency in the others plus resiliency, security, and lifecycle.
  • Customer‑facing technical leadership, design governance, risk management, and executive communication.
Preferred Qualifications
  • Large‑scale HPC or supercomputing architecture.
  • OEM GPU platforms, RDMA/RoCEv2 fabrics, parallel storage, liquid cooling, or cloud GPU architecture.
  • Cisco, Dell, HPE, Lenovo, Supermicro or equivalent validated‑system architecture.
  • NVIDIA infrastructure certification (or equivalent demonstrated delivery expertise) and cloud or data center architecture certifications.
Required Skills
  • DGX/HGX, GB200/NVL‑class or current NVIDIA rack‑scale platforms.
  • InfiniBand, Spectrum‑X, BlueField, ConnectX, UFM, NVLink/NVSwitch, BCM, Mission Control.
  • Digital‑twin and simulation tooling such as NVIDIA Air and Omniverse DSX blueprints.
Travel Requirements

Nationwide travel to customer data centers as required; percentage to be confirmed.

The compensation range for the position in the U.S. is - $179,760 to $341,520 based on a full‑time schedule. Your actual compensation may vary depending on your geography, job‑related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations:

California (San Francisco Bay Area): $215,640 to $409,800

California (All Other): $197,640 to $375,600

Colorado: $179,760 to $341,520

Massachusetts $179,760 to $375,600

New York City: $215,640 to $409,800

Washington: $197,640 to $375,600

Washington DC: $197,640 to $375,600

This position will be eligible for Kyndryl’s discretionary annual bonus program, based on performance and subject to the terms of Kyndryl’s applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off.

Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.

Applications will be accepted on a rolling basis.

Being You

Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single‑handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.

What You Can Expect

With state‑of‑the‑art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well‑being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learningprograms give you access to the best learning in the industry to receive certifications, includingMicrosoft, Google, Amazon, Skillsoft, and many more. Through our company‑wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non‑profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.

Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Architect
AI Infrastructure Architect

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 180,000 - 342,000
Medical and dental coverage
Discretionary annual bonus program
Paid time off
AI Validation & Automation Engineer
AI Validation & Automation Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 144,000 - 273,000
Medical coverage
Dental coverage
Retirement benefits
+2
AI Infrastructure Engineer
AI Infrastructure Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 144,000 - 273,000
Annual bonus
Medical & dental
Retirement plan
+1
NVIDIA AI Enterprise Forward Deployed Engineer
NVIDIA AI Enterprise Forward Deployed Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 115,000 - 219,000
Discretionary annual bonus
Medical and dental coverage
Paid leave
Observability & Scale Engineer
Observability & Scale Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 115,000 - 219,000
Restaurant d'entreprise
Indemnités de travail à distance
SOP, Knowledge & Readiness Lead
SOP, Knowledge & Readiness Lead

HITEC • San Francisco (CA), New York (NY)

On-site
USD 120,000 - 228,000
Medical insurance
Dental coverage
Disability coverage
+3
AI Infrastructure Architect
AI Infrastructure Architect

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 180,000 - 342,000
Discretionary annual bonus
Medical & dental coverage
Retirement benefits
AI Platform Operations Engineer
AI Platform Operations Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 144,000 - 273,000
Discretionary annual bonus
Comprehensive benefits package
Client Technical Solutioner
Client Technical Solutioner

Kyndryl Canada • Dallas (TX)

On-site
USD 110,000 - 170,000
SOP, Knowledge & Readiness Lead
SOP, Knowledge & Readiness Lead

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 100,000 - 190,000
Bonus program
Comprehensive benefits package