AI Infrastructure Engineer

Akkodis; Town of Florida (NY); On-site; USD 125,000 - 130,000; Full time

Benefits offered by this job

401(k) with match

Comprehensive medical insurance (PPO, HSA)

Dental insurance (PPO)

Vision assistance

Paid Time Off

Paid Holidays Off

Job summary

A leading technology company is seeking an experienced AI Infrastructure Engineer for a Direct Hire role located in New York, NY. The ideal candidate should have a strong financial services background and experience with NVIDIA AI infrastructure. Responsibilities include deploying containerized workloads, automating infrastructure operations, and ensuring platform reliability. Educational requirements include a Bachelor's degree with at least 8 years of experience. Competitive salary range is offered, alongside comprehensive benefits.

Qualifications

• 8-10 years of related experience required, experience in the financial services industry is a plus.
• Familiarity with GPU resource management.
• Exposure to hybrid GPU environments.

Responsibilities

• Support enterprise-grade NVIDIA AI infrastructure for ML/AI.
• Deploy and monitor AI workloads using Kubernetes and Docker.
• Automate infrastructure operations using Python and Terraform.

Skills

Linux administration (RHEL/Ubuntu)

Container orchestration (Kubernetes, Docker)

Infrastructure automation (Terraform, Ansible)

Python scripting

Networking fundamentals

Analytical and troubleshooting skills

Effective communication

Education

Bachelor's degree in computer science or related discipline

Tools

GitLab CI

Jenkins

NVIDIA GPU Operator

AWS

GCP

Azure

Job description

Akkodis is seeking a AI Infrastructure Engineer for a Direct Hire position with a client located in Lake Mary FL or Pittsburgh PA. Ideally looking for applicants with a solid background in the financial services industry.

Pay Range: $125,000 to $130,000

AI Infrastructure Engineer job responsibilities include:

• Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.
• Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM.
• Own the observability of our AI platforms—monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.
• Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.
• Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To fulfill this role the AI Infrastructure Engineer will be required to:

• Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.
• Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging.
• Proven experience running distributed systems in Kubernetes and containerized environments using Docker.
• Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle.
• Experience with CI/CD workflows and infrastructure automation tools such as GitLab CI, Jenkins, Terraform, Helm, or Ansible.
• Knowledge of networking fundamentals and persistent storage systems.
• Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments.
• Ability to read and support Python code focused on ML/AI pipeline integration.
• Strong analytical and troubleshooting skills with a collaborative mindset.
• Effective communication skills and proactive ownership of platform reliability and performance.

If you are interested in this AI Infrastructure Engineer job in New York, NY, then please click APPLY NOW. For other opportunities available at Akkodis go to www.akkodis.com. If you have questions about the position, please contact Varun Mahajan at 610-230-7027 or [e-mail].

Equal Opportunity Employer/Veterans/Disabled

(INCLUDE YOUR CLIENT’S BENEFITS HERE)

Benefits include but are not limited to:

• 401(k) with match
• Comprehensive medical insurance (PPO, HSA)
• Dental insurance (PPO)
• Vision assistance
• Three weeks of Paid Time Off to Start; Accumulating Structure Afterwards
• Paid Holidays Off

Available paid leave may include Paid Sick Leave, where required by law; any other paid leave required by Federal, State, or local law; and Holiday pays upon meeting eligibility criteria.

To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit https://www.modis.com/en-us/candidate-privacy/

The Company will consider qualified applicants with arrest and conviction records.