Software Engineer, Fleet Infra on Hyperscale Azure & Kubernetes

Cloudjobs; New York (NY); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

Cloudjobs is seeking an infrastructure-focused engineer to design, implement, and operate systems for deploying and training AI models on a massive GPU fleet in New York.

You will own job scheduling, cluster provisioning, and high-performance snapshot delivery, collaborating with software and ML teams to ensure scalable, reliable workflows.

Candidate should have strong programming skills and hands-on experience with hyperscale compute, Azure, and Kubernetes; AI/ML workload knowledge is a bonus.

Qualifications

• Experience with hyperscale compute systems and GPU workloads.
• Proficient in Azure and Kubernetes.
• Knowledge of AI/ML workloads is a plus.

Responsibilities

• Design, implement, and operate infrastructure for model deployment and training on a large-scale GPU fleet.
• Oversee job scheduling, cluster provisioning, and high-performance snapshot delivery.

Skills

Hyperscale compute systems

Azure

Kubernetes

Job scheduling

Cluster management

CI/CD systems

Programming

AI/ML workloads

Job description

Cloudjobs is seeking an infrastructure-focused engineer to design, implement, and operate systems for deploying and training AI models on a massive GPU fleet in New York.

You will own job scheduling, cluster provisioning, and high-performance snapshot delivery, collaborating with software and ML teams to ensure scalable, reliable workflows.

Candidate should have strong programming skills and hands-on experience with hyperscale compute, Azure, and Kubernetes; AI/ML workload knowledge is a bonus.