AI Infrastructure Engineer with NVIDIA Experience

MARS-TECHNOMINDS, INC; Town of Florida (NY); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading technology company is seeking an AI Infrastructure Engineer to join their team. This position involves hands-on work with NVIDIA AI infrastructure and supporting GPU-based compute systems. The ideal candidate will possess a Bachelor's degree in computer science or a related field, with 8-10 years of relevant experience. Responsibilities include deploying AI workloads, monitoring systems, and automating infrastructure operations. Experience in the securities or financial services industry is preferred.

Qualifications

• 8-10 years of related experience required.
• Experience in the securities or financial services industry is a plus.

Responsibilities

• Support GPU-based compute and high-performance storage systems for ML/AI.
• Maintain and troubleshoot containerized AI workloads.
• Monitor health and performance of AI platforms.
• Automate operations using Python, Bash, and Terraform or Ansible.
• Integrate workflows into CI/CD systems.

Skills

Hands-on with NVIDIA AI infrastructure

Container orchestration using Kubernetes

Monitoring and troubleshooting AI workloads

Python automation

Bash scripting

Terraform or Ansible

Education

Bachelor's degree in computer science or related discipline

Advanced degree preferred

Tools

Kubernetes

Docker

Run:AI

NVIDIA BCM

Job description

We’re seeking a future team member for the role of AI Infrastructure Engineer to join our Technology team. This role is located in Lake Mary, FL or Pittsburgh, PA

In this role, you’ll make an impact in the following ways:

Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.

Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM.

Own the observability of our AI platforms—monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.

Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.

Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To be successful in this role, we’re seeking the following:

Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.