AI Infrastructure Engineer: Scale GPU ML Pipelines

Akkodis

Town of Florida (NY)

On-site

USD 125,000 - 130,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

401(k) with match
Comprehensive medical insurance (PPO, HSA)
Dental insurance (PPO)
Vision assistance
Paid Time Off
Paid Holidays Off

Job summary

A leading technology company is seeking an experienced AI Infrastructure Engineer for a Direct Hire role located in New York, NY. The ideal candidate should have a strong financial services background and experience with NVIDIA AI infrastructure. Responsibilities include deploying containerized workloads, automating infrastructure operations, and ensuring platform reliability. Educational requirements include a Bachelor's degree with at least 8 years of experience. Competitive salary range is offered, alongside comprehensive benefits.

Qualifications

  • 8-10 years of related experience required, experience in the financial services industry is a plus.
  • Familiarity with GPU resource management.
  • Exposure to hybrid GPU environments.

Responsibilities

  • Support enterprise-grade NVIDIA AI infrastructure for ML/AI.
  • Deploy and monitor AI workloads using Kubernetes and Docker.
  • Automate infrastructure operations using Python and Terraform.

Skills

Linux administration (RHEL/Ubuntu)
Container orchestration (Kubernetes, Docker)
Infrastructure automation (Terraform, Ansible)
Python scripting
Networking fundamentals
Analytical and troubleshooting skills
Effective communication

Education

Bachelor's degree in computer science or related discipline

Tools

GitLab CI
Jenkins
NVIDIA GPU Operator
AWS
GCP
Azure

Job description

A leading technology company is seeking an experienced AI Infrastructure Engineer for a Direct Hire role located in New York, NY. The ideal candidate should have a strong financial services background and experience with NVIDIA AI infrastructure. Responsibilities include deploying containerized workloads, automating infrastructure operations, and ensuring platform reliability. Educational requirements include a Bachelor's degree with at least 8 years of experience. Competitive salary range is offered, alongside comprehensive benefits.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer — GPU, Kubernetes & Automation
AI Infrastructure Engineer — GPU, Kubernetes & Automation

MARS-TECHNOMINDS, INC • Town of Florida (NY)

On-site
USD 100,000 - 130,000
AI Infrastructure Engineer with NVIDIA Experience
AI Infrastructure Engineer with NVIDIA Experience

MARS-TECHNOMINDS, INC • Town of Florida (NY)

On-site
USD 100,000 - 130,000
Staff AI Research Infra Engineer - GPU Scale & Equity
Staff AI Research Infra Engineer - GPU Scale & Equity

Databricks Inc. • New York (NY)

On-site
USD 199,000 - 270,000
Senior GPU Systems Engineer: Scale AI Clusters & HPC
Senior GPU Systems Engineer: Scale AI Clusters & HPC

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
Infrastructure Engineer: Scale Low-Latency AI Compute (NYC)
Infrastructure Engineer: Scale Low-Latency AI Compute (NYC)

Harnham • New York (NY)

On-site
USD 200,000 - 440,000
Lead AI Infrastructure Solutions Architect for HPC Clusters
Lead AI Infrastructure Solutions Architect for HPC Clusters

NVIDIA • New York (NY)

On-site
USD 184,000 - 357,000
Senior AI GPU Infra Engineer — Performance & Scale
Senior AI GPU Infra Engineer — Performance & Scale

Summit Group Solutions, LLC • United States

On-site
USD 150,000 - 350,000
AI Infrastructure Engineer — GPU Kubernetes for Production
AI Infrastructure Engineer — GPU Kubernetes for Production

vCluster • Germany (OH)

On-site
USD 150,000 - 200,000
Competitive Salary
Platinum-Level Insurance
Flexible Working Schedule
+1
AI Infra Engineer: Kubernetes on Bare Metal GPUs (Remote)
AI Infra Engineer: Kubernetes on Bare Metal GPUs (Remote)

vCluster • New York (NY)

Hybrid
USD 150,000 - 200,000
Competitive Salary
Platinum-Level Insurance
Flexible Working Schedule
+1
Infrastructure Engineer - AI-Scale GPU & Cloud (Remote)
Infrastructure Engineer - AI-Scale GPU & Cloud (Remote)

Subconscious Systems Technologies, Inc. • Boston (MA)

On-site
USD 170,000 - 220,000