AI Infrastructure / ML Infrastructure Engineer

DeWinter Group; Campbell (CA); On-site; USD 68,880 - 241,080; Full time

Job summary

A technology consulting firm is looking for an AI Infrastructure / ML Infrastructure Engineer for a 12-month contract. This remote position involves managing and optimizing high-performance GPU clusters for AI applications. Candidates should have over 5 years of Cloud Infrastructure or DevOps experience, along with expertise in AWS, Kubernetes, and GPU orchestration. Ideal candidates can work autonomously and are expected to deliver results quickly in a collaborative environment.

Qualifications

• 5+ years of experience in Cloud Infrastructure or DevOps.
• Deep expertise in AWS/Azure/GCP, Kubernetes (EKS/GKE), and GPU orchestration.
• Demonstrated ability to work autonomously and manage time effectively.
• Experience with Terraform, Docker, and monitoring tools.

Responsibilities

• Provisioning and managing high-performance GPU clusters using Terraform or CloudFormation.
• Building and maintaining the internal 'Model Hub' for AI models.
• Optimizing networking and storage for multi-node distributed training.
• Implementing autoscaling logic for managing inference costs.
• Designing high-availability infrastructure for AI applications.

Skills

Cloud Infrastructure

DevOps

AWS

Azure

GCP

Kubernetes

GPU orchestration

Terraform

Docker

Prometheus

Grafana

Job description

Title: AI Infrastructure / ML Infrastructure Engineer

Job Type: Contract

Contract Length: 12 Months

Pay Range: $50/hr – $175/hr

Start Date: ASAP

Location: Remote

About the Opportunity

Our client, a leader in AI testing, is looking for a skilled AI Infrastructure / ML Infrastructure Engineer to join their team for a 12‑month engagement. This project involves provisioning, managing, and optimizing high-performance GPU clusters and infrastructure to support mission‑critical AI applications. This is a high‑impact role that requires a self‑motivated professional who can hit the ground running and deliver results quickly.

Key Responsibilities & Deliverables

• Provisioning and managing high-performance GPU clusters using Terraform or CloudFormation.
• Building and maintaining the internal "Model Hub" for versioning and deploying AI models across the company.
• Optimizing the networking and storage layers to support multi‑node distributed training.
• Implementing autoscaling logic to manage inference costs while meeting peak user demand.
• Designing high‑availability infrastructure for mission‑critical AI applications.

Required Skills & Experience

• 5+ years of experience in Cloud Infrastructure or DevOps.
• Deep expertise in AWS/Azure/GCP, Kubernetes (EKS/GKE), and GPU orchestration. This isn't a learning role—you need to be a subject matter expert.
• Demonstrated ability to work autonomously and manage your own time effectively to meet project goals.
• Experience with Terraform, Docker, and monitoring tools such as Prometheus and Grafana.
• Strong communication skills to provide clear and concise status updates to the project team.