Software Engineer, Fleet Infrastructure

Cloudjobs; New York (NY); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

Cloudjobs is seeking an infrastructure-focused engineer to design, implement, and operate systems for deploying and training AI models on a massive GPU fleet in New York.

You will own job scheduling, cluster provisioning, and high-performance snapshot delivery, collaborating with software and ML teams to ensure scalable, reliable workflows.

Candidate should have strong programming skills and hands-on experience with hyperscale compute, Azure, and Kubernetes; AI/ML workload knowledge is a bonus.

Qualifications

• Experience with hyperscale compute systems and GPU workloads.
• Proficient in Azure and Kubernetes.
• Knowledge of AI/ML workloads is a plus.

Responsibilities

• Design, implement, and operate infrastructure for model deployment and training on a large-scale GPU fleet.
• Oversee job scheduling, cluster provisioning, and high-performance snapshot delivery.

Skills

Hyperscale compute systems

Azure

Kubernetes

Job scheduling

Cluster management

CI/CD systems

Programming

AI/ML workloads

Job description

Design, implement, and operate infrastructure systems for model deployment and training on a large-scale GPU fleet. This includes managing job scheduling, cluster provisioning, and high-performance snapshot delivery.

Requirements

Candidates should have strong programming skills and experience with hyperscale compute systems, specifically using Azure and Kubernetes. An understanding of AI/ML workloads is considered a bonus.

Key Skills

• Hyperscale compute systems
• Azure
• Kubernetes
• Job scheduling
• Cluster management
• CI/CD systems
• Programming
• AI/ML workloads

Benefits

• Relocation assistance