AI Validation & Automation Engineer

Kyndryl Inc.

Frisco (TX)

Hybrid

USD 144,000 - 273,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental insurance
Disability insurance
Retirement benefits
Paid leave
Paid time off
Bonus program

Job summary

Kyndryl is seeking an AI Validation & Automation Engineer to lead infrastructure readiness, performance baselining, and defect-closure activities. You will automate health checks, evidence collection, and acceptance packages for NVIDIA DGX/HGX environments, GPUs, and HPC fabrics.

You will validate systems end-to-end, execute failure/recovery tests, and drive continuous improvement through automated coverage and auditable records. This role requires extensive travel to data centers nationwide.

Qualifications

  • 5+ years in infrastructure validation, automation, performance engineering, commissioning, or quality engineering.
  • Strong Linux scripting and automation with Python, Ansible, APIs, Git, and CI/CD.
  • Experience defining acceptance criteria, analyzing diagnostics, and managing defects to closure.

Responsibilities

  • Create a requirements-to-test traceability matrix and staged entry/exit gates for site readiness, physical installation, power-on, fabric, storage, platform, burn-in, performance, resiliency, and handover.
  • Develop version-controlled provisioning, health-check, diagnostic, stress, regression, and evidence-collection automation.
  • Validate GPU or accelerator health, PCIe, GPU interconnects, NIC/HCA/DPU, InfiniBand or Ethernet/RoCE fabrics, storage throughput, Kubernetes, operators, scheduling, and telemetry.
  • Execute failure and recovery tests including node loss, link degradation, service restart, workload rescheduling, rebuild, replacement, and return to service.
  • Establish workload-relevant baselines for collective communications, network, storage, inference, training, and platform operations.
  • Triage failures, isolate defects, coordinate corrective actions, retest, and maintain auditable defect and acceptance records.
  • Produce formal acceptance packages containing configuration baselines, test results, exceptions, waivers, evidence, sign-offs, and residual risks.
  • Use deployment findings and production incidents to extend automated coverage and prevent recurrence.

Skills

Linux scripting
Python
Ansible
APIs
Git
CI/CD
Automation

Tools

NVIDIA DCGM
Kubernetes
NVIDIA DGX/HGX
NCCL

Job description

## AI Validation & Automation EngineerApply: Partially Remote: Dallas (USDALFRI) Frisco AI HUB: Full time: Posted Today: R-71415**Who We Are**At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.**The Role**Accountable for objective proof that the infrastructure is ready for production. Owns validation, performance baselines, defect closure, and the acceptance evidence that supports customer sign-off and go/no-go decisions. ## Key responsibilities· Create a requirements-to-test traceability matrix and staged entry/exit gates for site readiness, physical installation, power-on, fabric, storage, platform, burn-in, performance, resiliency, and handover.· Develop version-controlled provisioning, health-check, diagnostic, stress, regression, and evidence-collection automation.· Validate GPU or accelerator health, PCIe, GPU interconnect (for example NVLink/NVSwitch), NIC/HCA/DPU, InfiniBand or Ethernet/RoCE fabrics, storage throughput, Kubernetes, operators, scheduling, and telemetry.· Execute failure and recovery tests including node loss, link degradation, service restart, workload rescheduling, rebuild, replacement, and return to service.· Establish workload-relevant baselines for collective communications, network, storage, inference, training, and platform operations without assuming ownership of every customer model benchmark.· Triage failures, isolate defects, coordinate corrective actions, retest, and maintain auditable defect and acceptance records.· Produce formal acceptance packages containing configuration baselines, test results, exceptions, waivers, evidence, sign-offs, and residual risks.· Use deployment findings and production incidents to extend automated coverage and prevent recurrence.Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof of vaccination to align with their respective COVID-19 vaccination policies. Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment.**Who You Are**## **Required Experience**· 5+ years in infrastructure validation, automation, performance engineering, commissioning, or quality engineering.· Strong Linux scripting and automation with Python, Ansible, APIs, Git, and CI/CD.· Experience defining acceptance criteria, analyzing diagnostics, and managing defects to closure. **Preferred Skills**· NVIDIA DCGM diagnostics and telemetry, CVT, MLXlink, fabric validation, GPU burn-in, NCCL tests.· Validation of DGX/HGX, InfiniBand, Spectrum-X, BlueField, Kubernetes operators, NVAIE, or Run:ai.· Experience producing customer acceptance packages for NVIDIA DGX/HGX or NVIDIA-Certified AI infrastructure.· NVIDIA or HPC benchmarking credentials and test-engineering credentials (for example ISTQB or equivalent). ## Travel RequirementsNationwide travel to customer data centers as required; percentage to be confirmed. The compensation range for the position in the U.S. is - $143,640 to $273,000 based on a full-time schedule. Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations: California (San Francisco Bay Area): $172,440 to $327,600California (All Other): $158,040 to $300,360Colorado: $143,640 to $273,000Massachusetts: $143,640 to $300,360New York City: $172,440 to $327,600Washington: $158,040 to $300,360Washington DC: $158,040 to $300,360 This position will be eligible for Kyndryl’s discretionary annual bonus program, based on performance and subject to the terms of Kyndryl’s applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off. Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.Applications will be accepted on a rolling basis.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer
AI Infrastructure Engineer

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 144,000 - 273,000
NVIDIA AI Enterprise Forward Deployed Engineer
NVIDIA AI Enterprise Forward Deployed Engineer

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 115,000 - 219,000
Discretionary annual bonus
Medical and dental coverage
Retirement benefits
+1
AI Infrastructure Architect
AI Infrastructure Architect

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 180,000 - 342,000
Discretionary annual bonus
Medical & dental coverage
Retirement benefits
AI Validation & Automation Engineer
AI Validation & Automation Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 144,000 - 273,000
Medical coverage
Dental coverage
Retirement benefits
+2
Observability & Scale Engineer
Observability & Scale Engineer

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 115,000 - 219,000
Annual bonus
Comprehensive benefits
AI Operational Readiness & Knowledge Lead
AI Operational Readiness & Knowledge Lead

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 100,000 - 190,000
Medical and dental coverage
Disability benefits
Retirement benefits
+2
AI Platform Operations Engineer
AI Platform Operations Engineer

Kyndryl Inc. • Frisco (TX)

Hybrid
USD 144,000 - 273,000
Medical coverage
Dental coverage
Disability benefits
+3
Associate Director, Full-stack Forward Deployed Engineer
Associate Director, Full-stack Forward Deployed Engineer

Kyndryl • Frisco (TX)

Hybrid
USD 144,000 - 273,000
Discretionary annual bonus
Medical and dental coverage
Retirement benefits
+2
NVIDIA AI Enterprise Forward Deployed Engineer
NVIDIA AI Enterprise Forward Deployed Engineer

1000 Kyndryl, Inc. • Dallas (TX)

On-site
USD 115,000 - 219,000
Discretionary annual bonus
Medical and dental coverage
Paid leave
Cloud Solutions Architect
Cloud Solutions Architect

Kyndryl Inc. • Dallas (TX)

Hybrid
USD 144,000 - 273,000