Staff Infra Engineer – Large-Scale GPU Training

Hark; San Jose (CA); On-site; USD 180,000 - 450,000; Full time

Job summary

Hark in San Jose, California, is seeking a Member of Technical Staff, Infrastructure Compute to manage large-scale GPU computing clusters for AI training and deployment. This critical role requires extensive experience in infrastructure and systems engineering along with strong knowledge of machine learning environments.

The ideal candidate will have a proven track record in managing distributed compute infrastructure, focusing on reliability and scalability. Competitive compensation package is offered for this full-time role.

Qualifications

• 5+ years of experience in infrastructure, systems, or platform engineering.
• Experience managing GPU clusters or large-scale distributed compute infrastructure.
• Strong proficiency in systems or infrastructure programming languages.

Responsibilities

• Design and maintain Infrastructure as Code (IaC) for cluster provisioning.
• Enhance CI/CD pipelines for model service delivery.
• Own stable training infrastructure for 10,000+ GPUs.

Skills

Systems engineering

Machine learning infrastructure

GPU management

Container orchestration

Tools

Kubernetes

Pulumi

Job description

Hark in San Jose, California, is seeking a Member of Technical Staff, Infrastructure Compute to manage large-scale GPU computing clusters for AI training and deployment. This critical role requires extensive experience in infrastructure and systems engineering along with strong knowledge of machine learning environments.

The ideal candidate will have a proven track record in managing distributed compute infrastructure, focusing on reliability and scalability. Competitive compensation package is offered for this full-time role.